Global Life Insurer - Asia AI Quality Evaluation Engineer

Asia AI Quality and Evaluation Engineer

Regional AI Centre of Excellence | Global Life Insurer

Location: Hong Kong; candidates based in the Philippines or India may also be considered

Experience: 2–10+ years, depending on relevant agentic AI, ML or application experience

The opportunity

We are partnered with a global life insurer to build out its regional AI Centre of Excellence, supporting AI-led transformation across its Asian businesses. As machine learning, generative AI and agentic solutions become part of business workflows, robust evaluation will be central to their successful adoption.

As an AI Quality and Evaluation Engineer, you will help define what good performance looks like and build the evidence that supports confident release decisions. Working across engineering, data science and business teams, you will assess both technical behaviour and the ability of AI solutions to perform meaningful business tasks.

What you will do

• Create representative evaluation datasets and reference test sets.
• Define measurable business-task performance criteria with domain specialists.
• Build automated regression suites for ML, generative AI and agentic systems.
• Evaluate grounding, robustness, safety and tool-use behaviour.
• Produce clear, reproducible evidence for release and delivery stage-gate decisions.
• Establish continuous production evaluation to identify degradation and emerging risks.

What you will bring

• Strong coding and test automation skills.
• Experience designing experiments and measurable evaluation criteria.
• Knowledge of ML, generative AI or agentic-system evaluation.
• Ability to translate business expectations into practical tests and communicate results clearly.

Preferred: English and Chinese language capability, and insurance-industry experience.

Why this role

You will help shape evaluation practices for emerging AI technologies across a regional portfolio, with direct influence on how solutions are tested, released and monitored in production.

Apply

Please share your CV and a brief overview of relevant experience for a confidential discussion.

Argyll Scott Asia is acting as an Employment Business in relation to this vacancy.