Software Engineer

🔒 Confidential Employer
Posted 23 November 2024
LOCATION
London
TYPE
Full-time
LEVEL
Mid-Senior level
CATEGORY
Data Pipeline
This employer holds a UK Home Office sponsor license — sponsorship for this specific role is at the employer’s discretion

SKILLS

Developing data pipelines using core Python Business Intelligence concepts ETL/ELT with good level SQL skills Working with ETL tools like AWS Glue, Fivetran, Matillion Apache Airflow Agile, Jira, and Test management tools CI/CD process AWS Services like AWS Lambda, AWS Glue, S3, IAM, Cloudwatch, SQS

FULL DESCRIPTION

Software Engineer
London
Data Pipeline
ETL/ELT
Data Lake
CI/CD
We are looking for a Software Engineer with 6+ years of experience

Responsibilities
Ability to evaluate business requirements and map to the technical stories & tasks
Should possess good communication skills and be able to articulate thoughts clearly to business and team
Should be detail oriented with an analytical mind set
Requirements
Software Engineer with extensive experience of developing data pipelines using core Python
In-depth knowledge of Business Intelligence concepts like Data Lake, Data Warehouse, Data Mart, etc.
Experience of working on multiple Data Platforms like Teradata, Snowflake
Extensive exposure to ELT/ETL with good level SQL skills is required
Experience of working with at least one of the ETL tool like AWS Glue, Fivetran, Matillion, etc.
Good to have experience with Apache Airflow
Should have strong Test Process orientation and familiarity with use case identification
Should have hands-on experience in Agile, Jira, and Test management tools
Good to have exposure of developing an automation framework to validate data
Good understanding of CI/CD process
Good exposure to AWS Services like AWS Lambda, AWS Glue, S3, IAM, Cloudwatch, SQS, etc.

Sign up free — access 45,000+ UK sponsor-licensed jobs