Data Engineer

Full Time City and County of the City of London IT Job Pro UK


Are we looking for you?
As a Data professional, you have ambitions to work on transformational projects, building big data solutions and designing large-scale data processing systems, growing as a true consultant. You'll enjoy partnering with enterprise level customers on how to ingest, store, process, analyse, explore and visualise data on Public Cloud platforms.

Complex business problems excite you, and you want to use Big Data, Auto-ML, ML and visualisation tech (with others) to solve them.

In summary, here you will be designing cloud enterprise solutions architecture and helping to build big data solutions for customers by integrating structured,, semi-structured and unstructured data on low latency platforms.

Are you looking for us?

Our client is Google’s largest Premier Partner in Europe and a MSP.  They deliver leading-edge cloud services to some of the world’s most exciting brands, in sectors from retail through automotive to finance.

They expose you to some of the most exciting Cloud transformation and optimisation project opportunities utilising Google Cloud (GCP). Full training and certification on GCP are provided as part of an extensive on-boarding program even if your background is more AWS/Azure.

Example Data Project – Multinational Investment Bank – Largest in Europe

Increasing runtimes and lack of scalability of on-prem Risk Reporting Platform batch ETL process led to challenges meeting increasing volume of regulatory reporting requirements. Lack of dedicated development and UAT led to resource contention and hampered the agility of development and deployment of fixes.

What your future team delivered

Deployed a hybrid solution leveraging the performance and scalability of Cloud Storage, Compute Engine Managed Instance Groups and BigQuery to move the bulk of the data processing to GCP. All data is protected at rest with Customer Managed Encryption Keys (CMEK) and sensitive or PII data is encrypted prior to transfer to GCP and decrypted on premise once data processing is complete. Result was 18x faster data processing on GCP, leading security and cost savings for the bank.

Day to Day

Our client is dynamic and the role is varied (there is no 'typical day') so you’ll get involved in a wide range of activities (more production than POC) but here is what to expect:

Identify, scope and participate in the design and delivery of cloud data platform solutions, data storage, movement and orchestration solutions utilising GCP
Design and execute a platform modernisation approach for customers’ data environments
Design, coordinate and execute pilots, prototypes or proof of concepts, provide validation on specific scenarios and provide deployment guidance
Collaborate and share best practices/insights with engineering colleagues and the architect community
Travel to client sites as appropriate (when restrictions allow) Requirements
What skills we look for…  

Able to consult on various technologies around databases, data warehousing and big data e.g. BigQuery, Oracle, Redshift, Teradata, Hadoop.
Articulate communication skills to explain complex solutions to external or internal customers in a clear and concise manner, aligned with the ability to adjust style to a varied audience within an organisation.
Exposure to data science modelling, analytics & BI reporting (Tableau, Looker, Periscope, DataStudio).
History of working with Data warehouse solutions (on-premise & Public Cloud).
Good experience of SQL on relational & non-relational database (RedShift, BigQuery, MySQL, etc).
Analytical and design skills around the full end-to-end ETL lifecycle of data pipelines in large enterprise settings
Practical experience of data curation, cleansing, creation and maintenance of data sets for business purposes Benefits

25 days holiday
Google Certification Path
4 x salary life assurance
Contributory pension
Opportunity to join our Vitality Health Insurance scheme
Flexible working and work from home
Electric car lease scheme
Work From Home
Private Healthcare Plan
Employee Assistance Programme

To apply for this job please visit