Data Engineer (SQL and PySpark)
Job Description
Data Engineer
Location: Dunstable (near Luton) – Hybrid (up to 2 days onsite) Rate: £549 per day (Inside IR35 / Umbrella) Contract: Initial term until end of August
Overview
Whitbread is seeking a hands-on Data Engineer to build and maintain scalable, production-grade data pipelines within reusable, modular frameworks. This role focuses on engineering high-quality, durable solutions rather than one-off development.
Key Responsibilities
Design and develop end-to-end data pipelines using reusable frameworks
Build scalable data solutions using Python, SQL, and PySpark
Create modular frameworks separating configuration from orchestration
Implement robust automated testing (unit, integration, regression)
Establish and enforce data quality controls (schema, nulls, row counts, integrity checks)
Contribute to CI/CD pipelines and Git-based workflows
Troubleshoot and optimise data pipelines for reliability and performance
Required Experience
Strong Data Engineering background
Advanced Python and SQL skills
Experience with PySpark or distributed processing tools
Proven track record building reusable data frameworks
Strong testing experience (pytest, mock data, data validation techniques)
Solid understanding of data quality, integrity, and pipeline behaviour
Experience with CI/CD, Git, and code review processes
Desirable
Experience in enterprise or cloud-based data environments
Exposure to dbt, Great Expectations, or similar tools
Experience in retail, hospitality, or customer-focused industries
Job Summary
Similar Jobs
The largest community on the web to find and list jobs that aren't restricted by commutes or a specific location.
-
Senior IT Support Technician
- IT Job Pro
-
NET Engineer
- IT Job Pro
-
Data Specialist
- IT Job Pro

