My client are a prestigious government organisation based near Fareham, Hampshire. They are seeking a security cleared Data Engineer for contract engagement (outside IR35), initially until the end of March – with the strong possibility of extensions.
There is a need to provide central support to the Core Data Engineering Team around the development and processing of data deliveries from another government department as well as proving programming and data engineering support.
Skills and Experience
Extensive proven experience of data engineering and architectural techniques, including data wrangling, data profiling, data preparation, metadata development, and data upload/download;
Proven experience of 'big data' environments, including the Hadoop Stack (Cloudera), including data ingestion, processing and storage using HDFS, Spark, Hive and Impala;
Extensive hands-on experience of developing ETL functionality in a cloud or on-premise environment;
Experience of using tools such as python and SQL (in Spark) to profile, query and structure large-volume data;
Proven experience of using Cloud Services particularly in the context of Hadoop;
Experience of developing/utilising programming and query languages e.g. SQL (Hive Impala specifically), Python (through Spark), Scala.
SC-level clearance valid for at least 6 months on commencement of the contract.
Understanding of data bases and applying data models in relational database formats.Desirable
Experience of coaching and training others in programming and ETL techniques;
Experience of UK Government, particularly HMRC Administrative Data
To apply for this job please visit itjobpro.co.uk.