Job Description

Posted 2 weeks ago

Lead Data Engineer ( Databricks )
London – Hybrid – Remote
Permanent
£100,000 – £130,000 plus up to 20% bonus based on performance and commercial contribution

About the Role

We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements.

This is a senior client-facing leadership role, blending hands-on technical delivery with architectural design and pre-sales influence.

You'll be leading high-performing squads, guiding complex transformations, and working directly with senior stakeholders to bridge business needs and engineering excellence — particularly in industries like manufacturing, utilities, and aviation.

This is a key hire to support our clients expanding Databricks practice, to build capacity for future growth.

What You’ll Be Doing

* Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks.

* Architect robust, scalable data platforms using the medallion architecture.

* Translate business requirements into scalable workflows, advising on data governance, quality, and security.

* Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog.

* Guide teams in implementing best practices across engineering, DevOps, and model deployment.

* Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps.

* Provide technical leadership, mentorship, and oversight to squads of Senior and Associate Engineers.

* Collaborate closely with Platform Engineers and Platform Architects to align infrastructure with data needs.

* Contribute to growing the Databricks capability – from delivery frameworks to internal tooling and capability development.

* Lead a team of data engineers, fostering a collaborative and growth-oriented environment.

* Evaluate new data engineering technologies and strategies, assessing their relevance and fit for the organisation’s strategic goals.

* Work closely with the commercial team to scope projects and develop proposals that align technical capabilities with client requirements.

Essential Skills & Experience

* 8+ years in data engineering, with at least 2+ in a technical leadership role

* Proven experience designing and leading Databricks-based data platforms

* Deep understanding of the medallion architecture, data lakehouse design, and transformation workflows

* Hands-on expertise with DLT, Unity Catalog, and model deployment frameworks

* Strong communication and consulting skills – able to lead client conversations and manage stakeholders

* Experience in agile delivery environments and cross-functional teams

* Commercial awareness – comfortable contributing to pre-sales, growing accounts, and engaging with commercial targets

Desirable Skills

* Experience in physical asset-heavy industries (e.g. utilities, manufacturing, aviation)

* Familiarity with platform and DevOps collaboration, especially on AWS or Azure

* Certifications in Databricks or cloud platforms (AWS/Azure)

* Background in consulting or client delivery environments

Why Join?

* Join a consultancy that’s doubling down on Databricks with enterprise-grade delivery

* Be the go-to technical leader on projects with real-world business impact

* Shape the future of our Databricks workforce strategy and delivery model

* Career progression into Delivery Lead, Practice Lead, or Pre-Sales Specialist

* Competitive compensation and strong bonus structure, aligned with delivery and commercial impact

To find out more about this high profile Lead Data Engineering position, click apply