Job Description

We're looking for a Developer in the London Area! The role will be integral to realising our client's vision and strategy in transforming some of their critical application and data engineering components. As a global financial market infrastructure and data provider, our client keeps abreast of the latest cutting technologies enabling their core services and business requirements.

Your Responsibilities

• Design, build, and optimise scalable data pipelines for batch and streaming workloads
• Develop and manage dataflows, and semantic models to support specific analytics related business requirements
• Implement complex transformations, aggregations, and joins ensuring performance, and reliability
• Implement and apply robust data validations, cleansing, and profiling techniques to ensure data accuracy and consistency across datasets
• Implement role-based access, data masking, and compliance protocols
• Performance tune and optimise jobs and workloads to reduce latency
• Work collaboratively with analysts and business stakeholders to translate requirements into technical solutions
• Create, maintain, and update documentation and internal knowledge repository

Your Profile

Essential Skills

• Experience of programming under Microsoft Azure Cloud Platform
• Experience of programming under Microsoft Fabric Platform
• Knowledge of Spark Programming (RDDs, Data Frames, Spark SQL)
• Python / Notebook programming
• PySpark programming
• Spark Streaming/batch processing
• Delta table Optimization
• Fabric spark jobs
• Java programming language, OOP knowledge
• Database knowledge (Relational and Non-SQL)
• Experience with Gitlab, Python unit test, CICD pipeline
• Good troubleshooting skills
• Familiar with Agile, good communication
• Good English listening and speaking
• Hands-on experience with lake houses, dataflows, pipelines, semantic models
• Ability to build ETL workflows
• Familiarity with time-series data, market feeds, transactional records, risk metrics
• Familiarity with Git, DevOps pipelines, automated deployment
• Strong communication skills, collaborative mindset

Desirable Skills

• Ability to prepare and process datasets for Power BI usage
• Experience with One Lake, Azure Data Lake, distributed computing environments
• Understanding of financial regulations (GDPR, SOX)
• Spark application performance tuning
• Knowledge of Docker / Kubernetes

Apply

Apply now! Contact [Employer hidden — sign up to reveal] at [Employer hidden — sign up to reveal].