AI Evaluation Lead

The AI Evaluation Lead position centres on define and own evaluation frameworks for GenAI outputs covering quality measures such as accuracy relevance robustness and hallucination rates. It would suit someone who can bring strong professional approach to the role.

Role overview

By joining us, you’ll play a key part in protecting consumers, driving economic growth, and shaping the future of UK finance services. Hybrid model where employees work a minimum of 40% in the office each month (expectation of 50% for senior leaders).

Main responsibilities

Define and own evaluation frameworks for GenAI outputs covering quality measures such as accuracy relevance robustness and hallucination rates. Managing delivery through well-defined work packages setting priorities operating standards and performance objectives including line management of Business Analysts. Managing digital and data-led change by encouraging innovative experiments and working with senior stakeholders while empowering a diverse team to collaborate openly.

What helps someone succeed

Strong professional approach.

Requirements

• Demonstrated experience leading people (line management, coaching, and performance reviews), capable of overseeing a portfolio of projects and adjusting delivery as priorities shif.
• Experience curating documenting and governing test datasets and benchmarks including version control to enable repeatable assessment and comparability over time.
• Clear written documentation skills producing evaluation reports test plans and assurance artefacts that are audit ready and suitable for governance forums.

Job details

• National (Edinburgh and Leeds) ranging from £72,100 to £100,000 and London from £79,300 to £110,000 per annum (salary offered will be based on skills and experience).
• Non-contributory pension (8–12% depending on age) and life assurance at eight times your salary.
• Private healthcare with Bupa, income protection, and 24/7 Employee Assistance.
• 28 days annual leave plus bank holidays.