Data Platform Engineer

🔒 Confidential Employer
Posted 7 May 2026
LOCATION
London
TYPE
Full-time
LEVEL
Mid-Senior level
CATEGORY
Technology
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

Python SQL Kafka Feast Databricks Azure Airflow Data Governance

FULL DESCRIPTION

Data Platform Engineer

[Employer hidden — sign up to reveal] Services Ltd is hiring a Data Platform Engineer in London. This is a full-time, permanent position with hybrid working.

Who We Are

Since its inception, [Employer hidden — sign up to reveal] has sought a different approach to insurance. We are on a mission to be the 'most inspiring specialty (re)insurance group in the world'. At the heart of [Employer hidden — sign up to reveal] are our people. Working together in dynamic, service-focused teams, we prioritise our customers in everything we do. Collaboration fuels our success, courage drives our innovation and continuous improvement keeps us ahead in a rapidly evolving industry. Our shared commitment is to revolutionise insurance for the better, one day at a time. We also believe that investing in our people is investing in our future. By empowering people across the Group to develop their careers, advance within the Group, and embrace new challenges, we build an environment where growth and learning never stop. Our competitive benefits package, offered via a flexible benefits platform, reflects this. Beyond core benefits, employees have the freedom to tailor their benefits to meet their individual needs, supporting their unique goals and ambitions.

Role Summary

As a Data / Platform Engineer, you will design and operate the event-streaming, telemetry, and feature-store foundations that fuel all intelligence within the digital suite. This is a pivotal role in building a trusted, real-time, ML‑ready data layer that accelerates every product across [Employer hidden — sign up to reveal]. Everything runs on streaming, telemetry, features, and trustworthy data, and you will be at the centre of it. Our digital suite is a governed decisioning system that unifies insurance from capacity to close, turning documents and data into evidence and converting rules and models into consistent, explainable, auditable outcomes. Built to replace outdated, disconnected systems, Atomx gives ambitious insurance brands a fully integrated ecosystem that removes silos and delivers the speed, clarity, and control teams need to build what's next.

Key Responsibilities

  • Event-Driven Telemetry & Behavioural Signals: Architect the event-driven telemetry backbone capturing user interactions, system behaviours, and workflow signals across all digital platforms. Define consistent event schemas, taxonomies, and ACORD‑aligned behavioural models.
  • High-Scale, High-Reliability Data Pipelines: Build and operate batch and real-time pipelines to ingest, transform, enrich, and validate data from all digital suite products. Automate data quality checks, lineage capture, and SLA monitoring through modern data observability patterns.
  • Enterprise Feature Store Ownership: Develop and maintain the enterprise Feature Store (Feast, Hopsworks, Databricks FS). Ensure features are consistent between training and inference, fully governed, and discoverable across teams. Manage feature versioning, contracts, embeddings, and historical point-in-time correctness.
  • Data Modelling, Schemas & Standards: Implement canonical schemas aligned to industry standards (ACORD‑style entities) and internal capability matrices. Shape unified data model powering Scope search, pricing, underwriting, claims, finance, and analytics.
  • Data Governance, Lineage & Metadata: Drive end‑to‑end data governance: lineage, metadata cataloguing, validation frameworks, and schema evolution. Ensure all data is traceable, trusted, and production-grade.
  • ML Enablement & Historical Backtesting: Partner with ML engineers and scientists to create ML‑ready feature datasets and transformations. Support historical replay, time-travel datasets, and backtesting infrastructure for all digital platforms.
  • Cross‑Platform Engineering Collaboration: Work closely with product teams across the digital platforms to ensure smooth telemetry, consistent data flows, and scalable real-time integration patterns.

Role Requirements

  • Strong experience with Python, SQL, and at least one NoSQL technology.
  • Hands-on depth in distributed data processing, ETL/ELT patterns, and data workflow orchestration (Airflow, dbt, ADF, Dagster).
  • Solid engineering practices around testing, CI/CD, monitoring, and deployment.
  • Experience with Kafka, EventHub, Kinesis, or similar distributed log technologies.
  • Strong understanding of streaming schemas, consumer group strategy, watermarking, and stateful processing.
  • Practical experience building or operating feature stores (Feast, Hopsworks, Databricks FS).
  • Understanding of feature definitions, point-in-time joins, online/offline store separation, and feature lifecycle governance.
  • Deep knowledge of canonical modelling, schema evolution, lineage systems, and metadata frameworks.
  • Expertise with data services in Azure, AWS, or GCP (ADF, Glue, Dataflow, Databricks, serverless compute).
  • Exposure to BI/MI tools (Power BI, Tableau).

Management Duties

No

Equal Opportunities

We are an equal opportunity employer, and we are proud to share that 93% of our employees say they can be themselves at work. We aim to hire our industry's finest people because the best people drive the best outcomes. And we forever challenge the status quo because we know there are always ways to improve things. Because together, we're limitless. We value applicants from all backgrounds and foster a culture of inclusivity. We understand the need for flexibility, so work in a hybrid model. Please let us know if you require any reasonable adjustments during the recruitment process.

FCA Conduct Rules

Under the Senior Managers and Certification Regime the FCA and [Employer hidden — sign up to reveal] expects that:

  1. You must act with integrity.
  2. You must act with due skill, care and diligence.
  3. You must be open and cooperative with the FCA, the PRA and other regulators.
  4. You must pay due regard to the interests of customers and treat them fairly.
  5. You must observe proper standards of market conduct.
  6. You must act to deliver good outcomes for retail customers.
Sign up free — access 45,000+ UK sponsor-licensed jobs