Lead Data Engineer

🔒 Confidential Employer
Posted 24 March 2026
LOCATION
London
TYPE
Contract
LEVEL
Mid-Senior level
CATEGORY
IT Services
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

PySpark Azure Databricks Agentic AI Test-Driven Development Data Engineering Databricks

FULL DESCRIPTION

Lead Data Engineer (Databricks, Agentic AI) – Hybrid

[Employer hidden — view at passion-project.co.uk] are partnered with a market leading, high profile financial services company who urgently require a Lead Data Engineer contractor (Databricks) to join a dynmaic, fast placed, greenfield project team who are leveraging cutting edge AI technology to build a new data-driven platform, allowing real-time insights.

To be suitable, candidates must have substantial experience as a Lead Data Engineer (or similar) with the following technical experience:

  • Engineering with PySpark
  • Azure Databricks
  • Agentic AI development
  • Test-Driven Development (TDD)
  • Led data engineering projects or spearheaded small sized teams

Initial term: 3 months (high potential for extension)

1-2 stage remote interview process

Hybrid working model: 3 days per week in the City of London

This is an urgent requirement and requires a contractor available to start with 1-2 weeks’ notice.

If you are a Hands on engineer, Databricks expert and have experience developing Agentic solutions, looking for your next challenge, we encorouge you to apply with your latest CV.

Sign up free — access 45,000+ UK sponsor-licensed jobs