Data Engineer – Trading and Energy Markets

🔒 Confidential Employer
Posted 7 May 2026
LOCATION
Abingdon
TYPE
Full-time
LEVEL
Mid-Senior level
CATEGORY
Technology
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

Python SQL Apache Spark Delta Lake Azure DevOps Git Data Modelling CI/CD Pipelines

FULL DESCRIPTION

Data Engineer – Trading and Energy Markets

[Employer hidden — sign up to reveal] – Hybrid / Abingdon OX14, UK – Permanent, Full-time – Competitive salary

About the Role

We’re looking for a talented Data Engineer to join our Trading team at [Employer hidden — sign up to reveal]. This is a hands-on engineering role responsible for building and operating the data infrastructure that supports energy trading across UK Gas and Power markets.

You’ll work at the intersection of data engineering and live trading, ensuring traders have reliable, timely, and explainable access to market data, asset schedules, and trading positions. Data availability and correctness are business-critical, and this role has clear ownership of production pipelines.

The role is a hybrid location, with a requirement to be office based 1-2 times per week. Our Trading Desk is in Abingdon, just outside of Oxford.

About [Employer hidden — sign up to reveal]

[Employer hidden — sign up to reveal] is a fast-growing UK energy company. We’re powering the move towards renewables through innovation and technology. We generate power to support the National Grid when renewables can’t meet demand and we buy, sell and manage energy for businesses nationally.

With a portfolio including gas, batteries, solar, wind and hydrogen, our 83 sites, operational or in construction, have a potential to generate 983MW of power making us one of the leading flexible energy providers in the country. Optimised and operated using our market-leading software, iON+, we’re at the forefront of shaping a more efficient energy sector that is both reliable and sustainable.

Key Responsibilities

  • Build and maintain high-availability data pipelines for energy market data (e.g. EPEX, BMRS, NESO) using Python, SQL, and Spark
  • Support on data flows to ensure our Power Generation and Storage assets are delivering the appropriate contracted schedules.
  • Design and manage Delta Lake tables and SQL Databases, applying appropriate partitioning, optimisation, indexing, and data modelling strategies
  • Develop monitoring dashboards and alerting to provide transparency on pipeline health, data freshness, and failure states
  • Implement data quality checks, validation logic, and reconciliation across multiple market data sources
  • Optimise pipeline performance and manage compute cost through efficient Spark and SQL design
  • Produce and maintain clear technical documentation for data schemas, pipelines, and operational processes
  • Contribute to structured Git-based development workflows and CI/CD pipelines (Azure DevOps)
  • Support other business areas (Back and Middle Office) on ensuring they have the latest settlement and industry data delivered to them

What We’re Looking For

Essential

  • Strong Python and SQL skills, with experience building and operating data pipelines
  • Ability to contribute and implement SQL Database management techniques such as index maintenance and query optimisations
  • Hands-on experience with Spark, Delta Lake, and modern Lakehouse architectures
  • Familiarity with cloud PaaS data platforms such as Microsoft Fabric or Databricks
  • Solid understanding of data modelling, storage formats, and performance principles
  • Experience using Git and working within CI/CD pipelines
  • Comfortable working in an environment where data reliability directly impacts the business

Desirable

  • 2+ years’ experience in data engineering or a similar production-focused role
  • Exposure to energy markets, trading systems, or financial data
  • Knowledge of Microsoft Azure Cloud Services (e.g. Function Apps)
  • Experience integrating REST APIs or working with event-driven data
  • Familiarity with orchestration tools (e.g. Azure Data Factory)
  • Understanding of warehouse and lakehouse design patterns
  • Basic awareness of trading concepts such as positions, P&L, and market schedules

Why Join Us

  • Work on production systems used directly by a live trading desk
  • Opportunity to build deep expertise in energy markets and trading technology
  • SimplyHealth health cashback plan
  • 24/7 Private GP access
  • Salary Sacrifice EV Scheme
  • Discretionary performance-based bonus

Application Instructions

Apply for this position by completing the online form, including your personal details, CV, and responses to screening questions. The administrator of your data is [Employer hidden — sign up to reveal] with its registered office in Abingdon OX14, UK, OX14 1SY, at Suites D&E Windrush Court, Blacklands Way.

By applying you accept the Privacy Policy.

Sign up free — access 45,000+ UK sponsor-licensed jobs