Senior Data Engineer
SKILLS
FULL DESCRIPTION
Senior Data Engineer at [Employer hidden — sign up to reveal]
We are looking for an experienced Senior Data Engineer to design, build, and optimize modern, cloud-based data platforms that power analytics, AI, and data products across the organization. This role can be delivered on either AWS (with Databricks) or Azure/Fabric (with Databricks or native Fabric tooling).
Role Responsibilities
- Design and implement scalable data platforms and pipelines on AWS (with Databricks) or Azure/Fabric (with Databricks or native Fabric tooling).
- Develop reliable batch, streaming, and near-real-time pipelines using Spark and Delta Lake.
- Implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold).
- Deliver high-quality datasets for analytics, machine learning, causal modeling, and GenAI systems.
- Enable data pipelines for GenAI use cases (LLMs, RAG pipelines, vector databases).
- Design scalable logical and physical data models for analytical and operational use cases.
- Orchestrate workflows using Airflow, dbt, Databricks Workflows, Azure Data Factory, or equivalents.
- Apply modern architecture patterns including event-driven and streaming architectures.
- Ensure adherence to data governance, lineage, quality, and access control using Unity Catalog, AWS Lake Formation, or Microsoft Purview.
- Establish strong data observability including monitoring of data freshness, pipeline reliability, and SLA adherence.
- Enable data serving layers (APIs, feature inputs, analytical endpoints) to support downstream systems.
- Continuously monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency.
- Bring curiosity to every engagement: ask the right questions, apply common sense thinking, and help derive business requirements.
- Work closely with data scientists, ML engineers, analysts, and business stakeholders.
Must-Have Qualifications
- Strong experience with Apache Spark and Delta Lake.
- Strong programming skills in Python and SQL.
- Proven experience building batch and streaming data pipelines.
- Solid understanding of data modeling, data quality, and governance principles.
- Track A: AWS data services (S3, Glue, EMR, Redshift, Kinesis, Lambda) and Databricks.
- Track B: Microsoft Azure/Fabric (Data Factory, Synapse, Fabric Lakehouse, Azure Databricks).
- Experience with lakehouse architectures and distributed data systems.
- Naturally curious, strong problem-solving skills, collaborative approach.
Nice-to-Have Qualifications
- Deep expertise in both AWS and Azure/Fabric.
- Experience with GenAI and AI data systems (RAG pipelines, vector databases, LLM data preparation).
- CI/CD for data pipelines and infrastructure-as-code (Terraform, CloudFormation).
- Streaming technologies (Kafka), Spark optimization, advanced analytics.
- Experience building data products or large-scale analytics platforms.
About [Employer hidden — sign up to reveal]
[Employer hidden — sign up to reveal] is the experience innovation company that exists to unlock a better way to experience the world. We blend crafts, categories, and cultures to help brands unlock new value in an increasingly digital world. At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations including L’Oréal, Mars, Audi, P&G, Volkswagen, Dolby, and more. At [Employer hidden — sign up to reveal], we don’t just talk about transformation. We make it happen.
Benefits
- Flexibility with hybrid work options and 25 vacation days.
- Co-subsidized transportation & Multisport cards.
- Premium health insurance.
- Training policy for technical events, courses and certifications.
- Personal career development roadmap.
- Self-care program offering psychological consultations.
- Cozy office space.
- Exciting team events and company gatherings.
Application Process
Once you apply, our Talent Acquisition team at [Employer hidden — sign up to reveal] will review your application. Your CV should cover key information on relevant experiences and expertise. We do not require information such as age, gender, marital status, or a headshot. If you need reasonable accommodations, please indicate in your application or contact your Talent Partner. Beware of recruitment fraud.