Job Description

Posted 50 minutes ago

Data Engineer – Active SC, Databricks, PySpark

Up to £475 per day (Inside IR35)

Remote / London

6 months

My client is an International Consultancy who are recruiting for an Data Engineer with Active Security Clearance (SC) and strong Databricks and Azure experience to deliver and optimise Data engineering solutions.

Key requirements:

Proven experience as a Data Engineer with Active Security Clearance (SC)
Strong experience with Databricks, PySpark and Delta Lake
Expertise in Jobs & Workflows, cluster tuning, and performance optimisation
Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies)
Hands-on with Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions
Familiarity with CI/CD for Databricks deployments
Strong troubleshooting in distributed Data environments
Excellent communication and collaboration skills
Nice to have:

Immediate availability
Experience with enterprise-scale Databricks environments
Knowledge of Azure Synapse, Power BI and cost optimisation strategies

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)