Software Engineer - AI Evaluation
SKILLS
FULL DESCRIPTION
Software Engineer - AI Evaluation
[Employer hidden — sign up to reveal] is a technology and advisory firm on a mission to make boards more effective, and through them, build better businesses and benefit society. We are looking for a Software Engineer to join our AI team as its dedicated engineer.
The Role
AI is at the heart of what [Employer hidden — sign up to reveal] builds. You will build the AI evaluation suite and work closely with prompt engineers and subject matter experts.
- Design and build our AI evaluation suite
- Build across the full stack
- Work with prompt engineers and subject matter experts
- Help define how we measure AI quality
- Automate evaluation processes
- Contribute to AI-powered products
Person Specification
We are looking for a strong all-round engineer who is comfortable working independently, enjoys ambiguity and wants to work at the forefront of AI quality.
Required Skills and Experience
- Upper mid-level to senior professional software engineering experience
- Experience building AI powered products or tooling
- Full-stack experience
- Comfort working independently and in ambiguity
- Experience collaborating with non-engineers
- Strong focus on quality, testing and attention to detail
- Experience using AI coding tools
- Fluent written and spoken English
Nice to haves
- Experience with building evaluation suites for AI products
- Experience with Python and TypeScript
- Experience building internal tools, testing frameworks or data pipelines
- Experience at a startup or in a small team
Our Values
- Kindness & caring
- Curiosity & innovation
- Remarkable quality & service
Benefits
- Pension scheme
- Personal performance bonus
- 26 days holiday
- Bupa health & dental cover
- Group life assurance
- EAP
- Cycle to work scheme
Diversity, equity and inclusion
[Employer hidden — sign up to reveal] is committed to building a team that reflects the breadth of experience, background and perspective. We welcome applications from all backgrounds and do not discriminate.