Lead DevOps Engineer

Purpose of Job

Beghou Consulting is seeking a hands-on, proactive Site Reliability / DevOps Engineer to strengthen and scale our cloud foundation across Azure and AWS. In this role, you will be responsible for designing, automating, and maintaining mission‑critical infrastructure that powers our internal platforms, data engineering pipelines, and client-facing solutions. You will own Infrastructure as Code practices, build secure and reliable CI/CD workflows, and ensure our cloud environments meet high standards of performance, security, and resilience.

As a key technical contributor, you’ll collaborate closely with development, data engineering, and client teams to deliver cloud solutions that are repeatable, cost‑efficient, and aligned to best practices. You will play a central role in enabling modern data workloads through Databricks, driving automation through Python-based tooling, and strengthening our disaster recovery and operational readiness. This is an opportunity to have real ownership, influence architectural decisions, and help evolve a rapidly growing cloud ecosystem.

We'll trust you to:

Infrastructure as Code

Develop, maintain, and review Terraform modules to provision and manage cloud resources.

Apply best practices for Terraform state management, module design, and testing.

Leverage CDKTF (Terraform) or Terragrunt patterns where appropriate.

Cloud Platform & Data Platform Management

Architect and operate services in Azure and AWS (compute, storage, networking, databases).

Provision, configure, and manage Databricks workspaces, clusters and jobs to support data pipelines.

Implement tagging, cost-optimisation, and security controls across both clouds and Databricks environments.

CI/CD for Infrastructure

Build, test, and maintain Azure DevOps Pipelines or GitHub Actions to automate infrastructure provisioning and application deployment.

Manage source in Azure DevOps or GitHub repos, enforce branching strategies, pull-request workflows and policy-as-code checks.

Collaboration & Documentation

Partner with client and data engineering teams to integrate infrastructure changes safely into development workflows.

Produce clear architecture diagrams, runbooks, and “how-to” guides for both technical and non-technical stakeholders.

Programming & Automation

Write and maintain automation scripts and CLI tools in Python to streamline operational tasks.

Contribute to internal SDKs or libraries for shared tooling and infrastructure utilities.

You'll need to have:

Experience: 3+ years in a DevOps or SRE role with production workloads in Azure and AWS.

IaC Proficiency: Deep hands-on Terraform experience, including Terraform Cloud, Terragrunt, module design, and testing.

CI/CD Expertise: Proven ability building and maintaining Azure DevOps Pipelines and managing code in either Azure DevOps or GitHub repos.

Programming Skills: Strong Python scripting skills; able to write clean, testable, and reusable code.

Data Platform Understanding: Familiarity with provisioning and managing Databricks workspaces, clusters, and jobs.

Disaster Recovery: Experience designing DR plans, automated backups, and conducting restore drills.

Cloud Services: Solid understanding of core Azure and AWS services (VMs, networking, storage, IAM, RDS/SQL).

Problem-Solving: Excellent troubleshooting abilities and a calm, methodical approach to incident response.

Communication: Clear written and verbal communication; adept at documenting complex systems simply.

Preferred Qualifications

Advanced IaC Tools: Experience with CDK for Terraform (CDKTF) or Terragrunt for composing infrastructure patterns.

Languages: PowerShell, Bicep, Python, Terraform

Security & Compliance: Familiarity with cloud security best practices (CIS benchmarks, Azure Policy, AWS IAM policies).

Networking: In-depth knowledge of VPCs, VNets, load balancers, VPNs and cross-region connectivity.

Serverless & Containers: Experience with serverless platforms (Azure Functions, AWS Lambda) and container registries.