Data Engineer (Azure)

Full Time IT Job Pro UK

We are looking for an experienced Data Engineer

Requirements:

* Java Development Experience

* Data Matching Experience ideally on Big Match or another IBM Matching product.

* SQL

* Python Development Experience

* Familiarity with working in a Linux shell environment and developing shell scripts

* Experience with Hortonworks or similar platforms, in particular HBase, Ambari, Yarn, HDFS, Sqoop, and Oozie.

* Understanding of the role of AWS components such as Redshift, MSK, EC2 instances, and Cloud Watch.

Desire:

* Experience with Drone-based build pipelines using YAML.

* Experience building map-reduce jobs for bulk data operations

To apply for this job please visit itjobpro.co.uk.