Job Description

Posted 6 hours ago

Data Architect (Databricks)

Location: Leeds, 3 days per week on site
Rate: £700 per day Inside IR35
Duration: 12 months

Overview

We're looking for a hands-on Data Architect to design a scalable, secure data architecture on AWS, with Databricks as the central engine for all processing and transformation. Data models and tooling are already set, so this role is all about getting the most out of Databricks. You'll shape the technical design, set governance standards and mentor a team of experienced ETL engineers who are new to Databricks.

Key Responsibilities

Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines
Bring together source data from files and databases into a single AWS and Databricks platform
Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture
Make the right Databricks choices, including storage modes and compute cluster configuration
Define governance standards, including roles and responsibilities across Databricks and downstream data users
Work with other architects on best practice for data quality and observability
Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns

Key Requirements

Strong AWS experience
Deep hands-on Databricks experience, including performance and cost optimisation
Proven experience delivering Medallion architecture
Strong ETL background
Experience setting data governance standards
Confident mentoring and upskilling engineering teams

Desirable

Unity Catalog
PySpark and Spark performance tuning
Delta Lake
Data quality and observability tooling
Experience leading a team's move onto Databricks

Apply now or email for more information