Lead Databricks Engineer

Job Information

- Contract Type Permanent - Department [Employer hidden — view at passion-project.co.uk] Advanced - Required Skill [] - Number of Positions 1 - City Mansion House - Province Greater London - Postal Code EC4 - Country United Kingdom - Job Type NA - Industry Technology

Job Description/ Summary

Who we are [Employer hidden] is a next-generation technology consultancy, designed to accelerate delivery and build amazing teams. We deliver services across data, AI, and cloud and we’re building the next generation of tech leaders. Since 2017, we have established a market leading position supporting our clients build their data and technology teams and deliver enduring solutions.

About [Employer hidden] Advanced: [Employer hidden] Advanced is the delivery arm of [Employer hidden]. It is a fast-growing team working across an array of practices tasked with delivering client projects and leading teams of [Employer hidden] consultants. We are at the forefront of [Employer hidden]’s growth and instrumental in developing services and solutions for our clients and technology partners. [Employer hidden] Advanced offers opportunities for technical and commercial exposure across a wide range of industries and technical use cases. It is a tight knit team of motivated technology professionals where ongoing learning and development are central to our ethos and internal culture.

The Role We are seeking a highly skilled and experienced Lead Databricks Engineer to join our growing community specialising in Databricks. The successful applicant will have a strong background in training models to support a range of problem domains and be well versed in delivering and maintaining models in a production environment through applying MLOps best practice. The role will require familiarity with the relevant capabilities of Databricks and at least one of the major cloud service providers (AWS, Azure, or GCP). Advanced proficiency in Python and SQL is essential.

As a Senior Manager Databricks Engineer working in our [Employer hidden] Advanced team, you will play a key role in delivering high-quality data engineering projects to our clients, often in collaboration with Databricks' professional services team. In addition to hands-on technical work, you will often play a leadership role in [Employer hidden]’s delivery squads, providing technical guidance and ensuring best practices are followed throughout the project lifecycle. You will work closely with clients and internal stakeholders to translate business requirements into robust technical solutions, ensuring projects are delivered on time, within scope, and aligned with client expectations.

You will also support the growth and capability development of [Employer hidden] Advanced, particularly with respect to our Databricks delivery capabilities. This will include assuming line management and/or technical leadership roles within the team.

Key Responsibilities • Lead technical delivery within [Employer hidden]’s squads deployed on client project engagements, ensuring that [Employer hidden] is known for the quality of the technical solutions it provides. • Work with [Employer hidden] & client staff of other disciplines to understand and assess requirements, design solutions and inform delivery planning. • Seek, build, and maintain effective client relationships contributing to [Employer hidden]’s • commercial priorities and supporting our partnering approach to working with clients. • Line managing developers within the team, supporting their professional and personal development. • Promote a culture of engineering excellence within KA through curiosity, collaboration and contributions to the internal knowledge base • Participating in self-directed or group learning and upskilling (gaining [Employer hidden] funded • certifications) to ensure your technical skills stay up to date and industry relevant.

Required Skills & Experience • Design and deliver a platform using the expected features of Databricks • Demonstrable practical experience of training and deploying ML models on Databricks (has ideally attained a Databricks ML Engineer certification). • Ability to “pick the right tool for the job” when it comes to selecting the type of learning model and framework to apply to a given problem statement • Awareness of the cost implications of training, fine-tuning, testing and serving ML models. • Strong communication skills. • Ability to influence key technical and business decision makers. • Experience in both delivery/technical leadership and line management. • Experience mentoring junior technical personnel.

Diversity statement: At [Employer hidden], we not only strive to bridge the skills-gap in data and next-generation technology, but we are also committed to playing a key role in improving diversity in the tech industry. To that effect, we welcome candidates from all backgrounds and particularly encourage applications from groups currently underrepresented in the industry, including women, people from black and ethnic minority backgrounds, LGBTQ+ people, people with disability and those who are neurodivergent.

We know that potential applicants are sometimes put off if they don’t meet 100% of the requirements. We think individual experience, skills and passion make all the difference, so if you meet a good proportion of the criteria, we’d love to hear from you. We are committed to ensuring that all candidates have an equally positive experience, and equal chances for success regardless of any personal characteristics. Please speak to us if we can support you with any adjustments to our recruitment process.