Job Description

Posted 2 hours ago

AWS Data Engineer | 6m Contract | London, Hybrid – Outside IR35 

Daily Rate: £570 per day (Outside) Team: Data Engineering – Application Development
Overview:

Opus have partnered with a London Financial Services company who're seeking a Senior AWS Data Engineer with a background in Application Development to support in architecting and delivering a new PostgreSQL‑driven data platform which will be used to support core functions across investment reporting, risk analysis, regulatory output, and performance measurement.

This is a high‑impact greenfield build. You’ll take full ownership of the platform’s design and lead the transition away from Databricks and Excel-centric processes—shaping critical infrastructure that underpins the organisation’s investment operations.
What You’ll Work On
You’ll be responsible for designing and developing a scalable, secure PostgreSQL environment capable of supporting:

Portfolio valuation and holdings data
Performance and attribution reporting
Risk and analytics outputs
Regulatory and trustee disclosures
Data governance and operational controls

You’ll also oversee the migration of structured datasets from Databricks (Delta Lake/Spark) and replace manual Excel workflows with automated, well-governed pipelines to meet audit and regulatory standards.
Key Responsibilities

Build and maintain a secure PostgreSQL-based data platform
Lead the shift away from Databricks and spreadsheet‑dependent reporting
Create dimensional data models covering investments, pricing, performance and related domains
Develop reliable ETL/ELT processes in Python
Implement data quality, reconciliation and validation controls
Optimise database performance for analytical and reporting workloads
Ensure compliance with FCA and TPR regulatory guidelines
Set up access controls, security standards and permissioning
Establish monitoring, backup and disaster recovery solutions
Collaborate closely with investment, risk and finance teams

Essential Skills & Experience

5+ years’ experience in data engineering, application development or data platform roles
Strong PostgreSQL knowledge, including indexing, optimisation and partitioning
Background in financial or investment data environments
Advanced SQL and Python skills
Experience migrating data from platforms like Databricks
Confident with dimensional modelling, star schemas, SCDs etc.
Experience within regulated financial services

Desirable

Experience in pensions, asset management or institutional investing
Understanding of performance measurement and attribution
Exposure to Airflow or dbt
Cloud platform familiarity (Azure or AWS)
Knowledge of data governance best practice

About You

Highly detail‑driven with a strong approach to data quality
Comfortable operating in tightly regulated sectors
Able to explain technical concepts clearly to non‑technical audiences
Practical, proactive and solution‑focused

Why This Role?

A rare opportunity to build core investment data infrastructure from the ground up
High visibility and direct engagement with senior stakeholders across multiple business areas
Stable organisation with long‑term goals and purpose
Flexible hybrid arrangement requiring only occasional travel to the London office