Principal Data Engineer

🔒 Confidential Employer
Posted 28 April 2026
LOCATION
London
TYPE
Full-time
LEVEL
Director
SALARY
£120,000 / year
CATEGORY
Technology
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

SQL Python AWS Airflow Spark System design Machine Learning Data platforms

FULL DESCRIPTION

Principal Data Engineer

[Employer hidden — view at passion-project.co.uk]

London

£100-120k

Full-time

Hybrid

Director

About the role

Principal Data Engineers at [Employer hidden] are senior technical leaders who operate across multiple teams, embedding best practices, raising engineering standards, and enabling our most ambitious data, ML and AI initiatives

You will actively seek out the highest‑impact problems across multiple cross-functional squads, partnering closely with Machine Learning Engineers (MLEs), ML Engineering Managers, Product and Platform teams to ensure we build robust, scalable and future‑proof data foundations for ML‑driven products such as the Travel Assistant

Embedded Data Engineering (Embedded DE) is a core part of this role

You will work inside ML‑led teams, shaping architecture, guiding implementation, and ensuring alignment between Data Engineering and ML Engineering best practices across [Employer hidden]

Act as a technical authority across multiple teams, setting standards and patterns for data and ML‑adjacent infrastructure

Embed with ML teams to design, build and evolve data platforms supporting AI and ML workloads

Influence technical direction without direct line management responsibility

Partner with Data Engineering teams outside of ML to build a community and share best practices and findings across all areas

Identify systemic issues and proactively drive improvements across the data ecosystem

Look for short term and strategic opportunities to enhance core platforms with new self-serve enablement features for ML and DE

Partnering with MLEs to design data pipelines supporting model training, inference and experimentation

Designing and reviewing architectures for ML‑ready data platforms

Building and optimising data pipelines using SQL, Spark or Ray and Python

Defining best practices for orchestration using Airflow or similar tools

Supporting API‑driven and event‑based data access patterns

Working with AWS infrastructure such as ECS, vector databases and Bedrock APIs

Reviewing designs and code across teams to raise quality and consistency

Coaching engineers through pairing, design reviews and informal mentoring

Collaborating on innovative AI‑powered product features such as the Travel Assistant

Who you are

  • Extensive experience as a Senior, Staff or Principal Data Engineer operating across teams
  • Deep expertise in SQL and Python, with strong experience in Spark or similar tooling
  • Strong understanding of orchestration tools such as Apache Airflow
  • Experience designing data platforms for ML and AI workloads
  • A track record of introducing new technologies and practices, and handling ambiguity and multiple stakeholders
  • Hands‑on experience with AWS infrastructure (e.g. ECS, IAM, data storage, compute)
  • Familiarity with vector databases and modern AI/ML APIs (e.g. Bedrock)
  • Experience working closely with Machine Learning Engineers in production environments
  • Strong system design skills and the ability to influence through technical leadership
Sign up free — access 45,000+ UK sponsor-licensed jobs