Senior Data Engineer
SKILLS
FULL DESCRIPTION
About us
We're [Employer hidden — view at passion-project.co.uk].
[Employer hidden] is a fresh alternative to Big Consulting. As an end-to-end transformation partner, we define, design, build and operate systems that solve our clients’ toughest challenges and seize their biggest opportunities. That often means combining strategy, data, AI, technology, and change management. Sometimes we manage and operate the systems we create; other times, we hand it over for the client to run – standing by to make improvements when things change. It all comes down to making an impact: improving lives, supporting citizens, streamlining workflows, and making the world a better place. We specialise in public sector and public-facing organisations—from government agencies and local authorities to energy, utilities, transportation and healthcare. We also work for some of the world’s most dynamic brands across automotive, retail, financial services, and consumer goods. We work closely (often on site) with our clients; to deliver impact you are keen to help us build the workforce of the future, we should talk.
We’re all in! That's what gets us out of bed every day. We hope you feel the same.
The Role: Senior Data Engineer
The Senior Data Engineer will be responsible for working as part of an Agile delivery squad with other data engineers and senior data engineers. Working to deliver data engineering on a range of data products for use in insight, reporting and analytics including AI, working closely with product owners, business analysts, data architects, data analysts, delivery projects managers and data scientists.
Department
: Technology: Data Technology
Employment Type
: Permanent - Full Time
Location
: London or Manchester UK
Workplace type
: Hybrid
Key Responsibilities
- Managing quality of own and teams’ outputs
- Delivering data engineering on a range of complex marketing and research processes
- Working with clients to understand needs, and best implement that with our available technology solutions
- Working with a range of data sources such as CRM, sales, research and HR data.
- Building Single Customer Views, CDPs or Data Warehouses/Data Lakes to merge disparate data sets for marketing or sales activation
- Building and configuring data ingestion methods from APIs, flat files, streaming, public data sources and survey data
Skills, Knowledge and Expertise
- Must have experience of using Azure or AWS Databricks and Medallion architecture
- Expert experience with Azure Data Factory or Python/Airflow and a range of associated libraries for data processing and manipulation
- Experience with a range of database technologies including data lakes such as Azure SQL, SQL Server, Azure Data Lake, PostgreSQL, Snowflake, MySQL, Cosmos DB or Mongo DB
- Understanding of Azure DevOps and CI/CD processes
- Knowledge of data warehouse or data lakes with SCVs or in conjunction with CDP platforms
- Knowledge of data ingestion of streaming data using Databricks and Pyspark
- Understanding and application of statistical methods
- Ability to lead, and to work well as part of, a team using the agile methodology
- A growth mindset
- AI curious and ready to embrace opportunities
Desirable Skills:
- Palantir Foundry (Pipeline Builder) experience
- Knowledge of ELT/ETL tools such as Informatica DEI/BDM and Talend would be beneficial
- Experience of mentoring junior to mid-level Data Engineers would be beneficial
Our culture and benefits
Our culture is built on:
- We raise the bar
- We look out for each other
- We embrace our differences
- We shape a changing world
- We’re all in
Our benefits include:
- Holiday entitlement, 28 days with the option to buy/sell up to 5 days (note that 3 days are held for Christmas holidays)
- Day off (on or in the week of) your birthday
- Pension eligibility, up to 5% matched contributions
- Private healthcare
- Life assurance
- Enhanced maternity and enhanced paternity and shared parental leave
- Cycle to work schemes
- Gym & retail discounts
- Regular social events/activities
- A range of other benefits from our flexible benefits package
At [Employer hidden], you can expect meaningful work, with real impact and the space to grow as people as well as a professional.
You’ll work alongside curious, authentic experts who care deeply about doing the right thing, for our clients and for each other with no egos, no blame, and no standing on the sidelines.
We’re all in on creating an environment where people feel supported, included and trusted to do their best work. In return, we ask for curiosity, honesty and a willingness to lean into learning, quality, teamwork, and to making change that truly lasts.
We’re committed to equality of opportunity for all, and we actively seek applications from all ethnicities, orientations, beliefs, gender identities + those with neurodiverse traits and disabilities. We want you to have the best opportunity to show us who you are and what you can do. Please do let us know if you need any adjustments now or at any point in the recruitment process.
If this sounds like you, please get in touch to discuss in more detail.
Use of AI in CV and Interviews
We value authenticity and transparency in our hiring process. To ensure fairness and accuracy in assessing your skills and experience, we ask that you refrain from using AI-assisted tools to generate answers during the application process or within interviews.
We are looking for genuine insights into your abilities, experiences, and personality. Any misrepresentation through AI-generated content may impact our ability to make an informed decision. We look forward to getting to know the real you!