Job Description

Posted 2 weeks ago

Databricks Engineer (SC Cleared)

London (Hybrid)

6 Month Contract

£(Apply online only)/day (Inside IR35)

Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid).

Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start ASAP in Dec 2025.

Hybrid Working – 2 days/week remote (WFH), and 3 days/week working on-site from the Central London office.

A chance to work with a leading global IT and Digital transformation business specialising in Government projects:

In-depth Data Engineering + strong hands-on Azure Databricks expertise.

Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database.

Designing, developing, building + optimising data pipelines, implementing data transformations, ensuring data quality and reliability.

Deep Data Warehousing knowledge including data modelling techniques + data integration patterns.

Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design.

Implementing complex data transformations using Spark, PySpark or Scala + working with SQL / MySQL databases.

Experience with data quality, data governance processes, Git version control + Agile development environments.

Azure Data Engineer certification preferred -eg- Azure Data Engineer Associate.

Advantageous skills: Azure Event Hubs, Kafka, data visualisation tools, Power BI, Tableau, Azure DevOps, Docker, Kubernetes, Jenkins