AWS Data DevOps Engineer

🔒 Confidential Employer
Posted 23 April 2026
LOCATION
London
TYPE
Full-time
LEVEL
Mid-Senior level
CATEGORY
Technology
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

AWS Data Engineering S3 Terraform Python DevOps IAM OpenSearch

FULL DESCRIPTION

AWS DevOps Engineer

[Employer hidden — view at passion-project.co.uk] is seeking an AWS Data DevOps Engineer to join our team and play a key role in building, maintaining, and optimising our cloud-based data infrastructure. If you thrive in a fast-paced, tech-driven environment and have a passion for AWS, data pipelines, and automation, we’d love to hear from you!

Key Responsibilities

  • Design, implement, and maintain AWS-based data infrastructure to support scalable and secure data operations.
  • Develop and optimise data pipelines for processing, storing, and retrieving structured and unstructured data.
  • Work with Amazon OpenSearch to enable real-time search and analytics on large-scale datasets.
  • Implement and manage Lake Formation and AWS Security Lake, ensuring data governance, access control, and security compliance.
  • Optimise file formats (e.g., Parquet, ORC, Avro) for S3 storage, ensuring efficient querying and cost-effectiveness.
  • Automate infrastructure deployment using Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation.
  • Monitor and troubleshoot data workflows, ensuring high availability and performance.
  • Collaborate with data engineers, security teams, and DevOps professionals to build a resilient data ecosystem.

Experience

  • AWS Expertise – Strong experience with AWS services, including S3, Lambda, IAM, OpenSearch, Security Lake, and Lake Formation.
  • Data Engineering – Proficiency in building and optimising data pipelines and working with large-scale datasets.
  • File Formats & Storage – Hands-on experience with Parquet, ORC, Avro, and efficient S3 storage solutions.
  • DevOps & Automation – Experience with Terraform, CloudFormation, or CDK to automate infrastructure deployment.
  • Security & Compliance – Familiarity with AWS Security Lake, IAM policies, and access control best practices
  • Programming & Scripting – Proficiency in Python, Bash, or similar scripting languages for automation.
  • SC Clearance – Having or being eligible for Security Clearance (SC) is needed.
  • Team Leadership – Experience leading teams or mentoring engineers in data/DevOps projects.
  • Solution Leadership – Strong ability to architect and drive technical solutions, influencing key design decisions.

Keywords

  • AWS
  • Data Engineering
  • File Formats
  • Scripting
  • DevOps
Sign up free — access 45,000+ UK sponsor-licensed jobs