Software Engineer - AI Evaluation

🔒 Confidential Employer
Posted 16 October 2026
LOCATION
London
TYPE
Full-time
LEVEL
Mid-Senior level
CATEGORY
Software Engineering
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

Full-stack development Python TypeScript AI evaluation Testing frameworks Data pipelines Internal tooling AI coding tools

FULL DESCRIPTION

Software Engineer - AI Evaluation

[Employer hidden — sign up to reveal] is a technology and advisory firm on a mission to make boards more effective, and through them, build better businesses and benefit society. We are looking for a Software Engineer to join our AI team as its dedicated engineer.

The Role

AI is at the heart of what [Employer hidden — sign up to reveal] builds. You will build the AI evaluation suite and work closely with prompt engineers and subject matter experts.

  • Design and build our AI evaluation suite
  • Build across the full stack
  • Work with prompt engineers and subject matter experts
  • Help define how we measure AI quality
  • Automate evaluation processes
  • Contribute to AI-powered products

Person Specification

We are looking for a strong all-round engineer who is comfortable working independently, enjoys ambiguity and wants to work at the forefront of AI quality.

Required Skills and Experience

  • Upper mid-level to senior professional software engineering experience
  • Experience building AI powered products or tooling
  • Full-stack experience
  • Comfort working independently and in ambiguity
  • Experience collaborating with non-engineers
  • Strong focus on quality, testing and attention to detail
  • Experience using AI coding tools
  • Fluent written and spoken English

Nice to haves

  • Experience with building evaluation suites for AI products
  • Experience with Python and TypeScript
  • Experience building internal tools, testing frameworks or data pipelines
  • Experience at a startup or in a small team

Our Values

  • Kindness & caring
  • Curiosity & innovation
  • Remarkable quality & service

Benefits

  • Pension scheme
  • Personal performance bonus
  • 26 days holiday
  • Bupa health & dental cover
  • Group life assurance
  • EAP
  • Cycle to work scheme

Diversity, equity and inclusion

[Employer hidden — sign up to reveal] is committed to building a team that reflects the breadth of experience, background and perspective. We welcome applications from all backgrounds and do not discriminate.

Sign up free — access 45,000+ UK sponsor-licensed jobs