Job Description

Posted 1 week ago

DevOps Engineer
London, UK (3 days in office)
SC Cleared: Required
Experience: 5-8 years

Platform Design & Development:

* Design, develop, and maintain the core platform infrastructure on Azure, including networking, compute, storage, security, and identity management.

* Implement infrastructure-as-code (IaC) using tools like Terraform, ARM templates, or Bicep to automate infrastructure provisioning and management.

Azure Databricks Integration & Optimisation:

* Deeply integrate Azure Databricks into the platform, ensuring seamless access and efficient resource utilisation.

* Implement automation for Databricks workspace setup, cluster configuration, and job deployments.

* Optimise Databricks workloads for performance, scalability, and cost-effectiveness.

Containerisation & Orchestration:

* Implement and manage containerised applications and services using Docker and Kubernetes (or Azure Kubernetes Service – AKS).

* Design and implement container orchestration strategies for deploying and scaling platform components.

CI/CD Pipeline Automation:

* Design and implement robust CI/CD pipelines for building, testing, and deploying platform components and user applications.

Monitoring, Logging & Alerting:

* Implement comprehensive monitoring, logging, and alerting systems to proactively identify and address performance issues, errors, and security threats.

* Use tools like Azure Monitor, Prometheus, Grafana, or similar to collect and analyse metrics, logs, and traces.

* Configure alerts and notifications to ensure timely responses to critical events.

Documentation & Support:

* Develop and maintain comprehensive documentation for the platform, including API documentation, user guides, and troubleshooting guides.

Essential Skills & Experience:

* 5+ years of experience in platform engineering, DevOps engineering, or a related role.

* Strong experience with Azure cloud platform and services.

* Extensive experience with IaC tools like Terraform, ARM templates, or Bicep. Solid understanding of CI/CD principles and experience with CI/CD tools like Azure DevOps, Jenkins, or GitLab CI.

* Strong experience with containerisation technologies like Docker and orchestration tools like Kubernetes (or AKS).

* Experience with monitoring and logging tools.

* Scripting skills in PowerShell, Bash, YAML and Python.

* Experience with Azure Databricks and its integration with platform tooling

* Experience with configuration management tools like Ansible, Puppet, or Chef.

* Azure certifications (e.g., Azure DevOps Engineer Expert, Azure Administrator Associate, Azure Solutions Architect Expert)