AWS Data DevOps Engineer

🔒 Confidential Employer
Posted 23 August 2025
LOCATION
London
TYPE
Full-time
LEVEL
Mid-Senior level
CATEGORY
Technology
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

AWS Data Engineering S3 Terraform Python DevOps Security Lake OpenSearch

FULL DESCRIPTION

Summary

Valcon is seeking an AWS Data DevOps Engineer to join our team and play a key role in building, maintaining, and optimising our cloud-based data infrastructure. If you thrive in a fast-paced, tech-driven environment and have a passion for AWS, data pipelines, and automation, we’d love to hear from you!

Key Responsibilities:

  • Design, implement, and maintain AWS-based data infrastructure to support scalable and secure data operations.
  • Develop and optimise data pipelines for processing, storing, and retrieving structured and unstructured data.
  • Work with Amazon OpenSearch to enable real-time search and analytics on large-scale datasets.
  • Implement and manage Lake Formation and AWS Security Lake, ensuring data governance, access control, and security compliance.
  • Optimise file formats (e.g., Parquet, ORC, Avro) for S3 storage, ensuring efficient querying and cost-effectiveness.
  • Automate infrastructure deployment using Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation.
  • Monitor and troubleshoot data workflows, ensuring high availability and performance.
  • Collaborate with data engineers, security teams, and DevOps professionals to build a resilient data ecosystem.

Core Requirements:

  • AWS Expertise – Strong experience with AWS services, including S3, Lambda, IAM, OpenSearch, Security Lake, and Lake Formation.
  • Data Engineering – Proficiency in building and optimising data pipelines and working with large-scale datasets.
  • File Formats & Storage – Hands-on experience with Parquet, ORC, Avro, and efficient S3 storage solutions.
  • DevOps & Automation – Experience with Terraform, CloudFormation, or CDK to automate infrastructure deployment.
  • Security & Compliance – Familiarity with AWS Security Lake, IAM policies, and access control best practices
  • Programming & Scripting – Proficiency in Python, Bash, or similar scripting languages for automation.
  • SC Clearance – Having or being eligible for Security Clearance (SC) is needed.
  • Team Leadership – Experience leading teams or mentoring engineers in data/DevOps projects.
  • Solution Leadership – Strong ability to architect and drive technical solutions, influencing key design decisions.

Key Responsibilities

  • Design, implement, and maintain AWS-based data infrastructure to support scalable and secure data operations.
  • Develop and optimise data pipelines for processing, storing, and retrieving structured and unstructured data.
  • Work with Amazon OpenSearch to enable real-time search and analytics on large-scale datasets.
  • Implement and manage Lake Formation and AWS Security Lake, ensuring data governance, access control, and security compliance.
  • Optimise file formats (e.g., Parquet, ORC, Avro) for S3 storage, ensuring efficient querying and cost-effectiveness.
  • Automate infrastructure deployment using Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation.
  • Monitor and troubleshoot data workflows, ensuring high availability and performance.
  • Collaborate with data engineers, security teams, and DevOps professionals to build a resilient data ecosystem.

Experience

  • AWS Expertise – Strong experience with AWS services, including S3, Lambda, IAM, OpenSearch, Security Lake, and Lake Formation.
  • Data Engineering – Proficiency in building and optimising data pipelines and working with large-scale datasets.
  • File Formats & Storage – Hands-on experience with Parquet, ORC, Avro, and efficient S3 storage solutions.
  • DevOps & Automation – Experience with Terraform, CloudFormation, or CDK to automate infrastructure deployment.
  • Security & Compliance – Familiarity with AWS Security Lake, IAM policies, and access control best practices
  • Programming & Scripting – Proficiency in Python, Bash, or similar scripting languages for automation.
  • SC Clearance – Having or being eligible for Security Clearance (SC) is needed.
  • Team Leadership – Experience leading teams or mentoring engineers in data/DevOps projects.
  • Solution Leadership – Strong ability to architect and drive technical solutions, influencing key design decisions.
Sign up free — access 45,000+ UK sponsor-licensed jobs