Data Engineer
SKILLS
FULL DESCRIPTION
Data Engineer
[Employer hidden — sign up to reveal] is seeking a Data Engineer for support and maintenance of production data pipelines. Location: Leeds, UK / Reading, UK. Work Pattern: Hybrid. Travel: Mostly remote with occasional travel to customer and [Employer hidden — sign up to reveal] offices. Security Clearance: Not mandatory – good to have. Immediate joiners.
About [Employer hidden — sign up to reveal]
[Employer hidden — sign up to reveal] Limited is a global provider of enterprise AI, digital, and cloud services. With presence in over 40 countries and nearly 5,000 professionals, [Employer hidden — sign up to reveal] delivers innovative technology solutions. Through Lead with AI approach, we integrate intelligence across solutions. We partner with Oracle, Salesforce, Microsoft, AWS, Snowflake, and Databricks. Guided by values of Trust, Value, and Velocity.
About the Role
We are looking for a hands-on Data Engineer to run and maintain production data pipelines on Databricks and AWS. The role combines L2 and L3 production support with data engineering. You will work with service management, platform teams, data owners, and downstream users.
Key Responsibilities
- Monitor scheduled jobs, ingestion processes, and downstream loads.
- Own incidents from investigation through recovery and closure.
- Recover failed processing through controlled retries, reruns, and backfills.
- Investigate data quality issues, schema changes, and missing source files.
- Maintain and improve existing Python, PySpark, and SQL code.
- Tune Spark jobs and SQL queries for performance and cost.
- Troubleshoot S3 access, IAM permissions, and encrypted data access.
- Automate health checks, reconciliation, and support tasks.
- Maintain runbooks, dependency maps, and root cause analyses.
Essential Skills and Experience
- Proven experience supporting production data pipelines.
- Strong Python, PySpark, and SQL skills.
- Practical Databricks experience (notebooks, jobs, cluster config).
- Experience with Spark SQL, Delta Lake, Parquet, Hive metastore.
- Hands-on AWS experience (S3, IAM, CloudWatch).
- Understanding of batch and incremental processing, job dependencies.
- Experience implementing data quality checks and reconciliation.
- Working knowledge of Git, code reviews, CI/CD.
- Experience within incident, problem, and change management processes.
Why Join [Employer hidden — sign up to reveal]?
- Work on large-scale digital transformation programmes.
- Collaborate with highly skilled diverse teams.
- Access ongoing learning and certification opportunities.
- Enjoy clear career progression within a global organisation.
Our UK Benefits Include
- Competitive salary and annual bonus.
- Hybrid and flexible working options.
- Generous annual leave plus bank holidays.
- Company pension with employer contributions.
- Private medical insurance for self and dependants.
- Life assurance cover.
- Employee Assistance Programme.
- Wellbeing initiatives and gym support.
- Learning and development programmes.
- Employee recognition and reward schemes.
- Cycle to Work scheme.
- Employee referral bonus.
- Enhanced family-friendly policies.
Diversity & Inclusion
At [Employer hidden — sign up to reveal], we are committed to building a diverse workforce and creating an inclusive environment. We welcome applications from all backgrounds and are proud to be an equal opportunities employer.
Apply today and help shape the future with [Employer hidden — sign up to reveal].