Gen AI Data Engineer

🔒 Confidential Employer
Posted 7 May 2026
LOCATION
London
TYPE
Contract
LEVEL
Mid-Senior level
CATEGORY
Data & Analytics
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

PySpark Python SQL AWS GenAI/LLM Distributed Data Processing ETL/ELT Pipelines RAG Architectures

FULL DESCRIPTION

Gen AI Data Engineer - Pyspark/Python

Posted: 28 April 2026 | Location: London | Job Type: Contract | Discipline: Technology

Job description

The Role: GenAI Data Engineer
Location: London (or) Edinburgh, UK
Position Type: Contract Inside IR35
Remote work option Available: Hybrid – 2 Days Onsite

Essential skills/knowledge/experience:

  • Strong experience with PySpark, distributed data processing, and large scale ETL/ELT pipelines.
  • Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries, and implementing CDC, SCD Type 1/2/3 patterns for reliable data warehousing.
  • Advanced proficiency in Python for data engineering, automation, and ML/GenAI integration.
  • Hands‑on expertise with AWS services (S3, Glue, Lambda, EMR, Bedrock / custom model hosting).
  • Practical experience with GenAI/LLM model creation, fine tuning, benchmarking, and evaluation.
  • Solid understanding of RAG architectures, embeddings, vector stores, and LLM evaluation methods.
  • Experience working with structured and unstructured datasets (documents, logs, text, images).
  • Familiarity with scalable data storage solutions (Delta Lake, Parquet, Redshift, DynamoDB).
  • Understanding model optimization techniques (quantization, distillation, inference optimization).
  • Strong capability to debug, tune, and optimize distributed systems and AI pipelines.

Desirable skills/knowledge/experience:

  • PySpark, Python, SQL, AWS, GenAI

Contact

Consultant: [Employer hidden — sign up to reveal] from [Employer hidden — sign up to reveal]
Email: [Employer hidden — sign up to reveal]
Phone: [contact hidden]

Sign up free — access 45,000+ UK sponsor-licensed jobs