Technical Architect_D-2374 - Azure Databricks Developer- 8+ years

We are looking for a Technical Architect with working knowledge of Databricks to own the automation, deployment, and operational reliability of our enterprise data platform. The primary focus is DevOps — CI/CD pipelines, Terraform IaC, and GitHub workflows, with Databricks knowledge used to understand and operate what is being deployed.

Key Responsibilities

• Design and maintain CI/CD pipelines using GitHub Actions to deploy Databricks workspaces, jobs, and configurations across Dev, Test, and Production.

• Own the Terraform codebases for all Databricks and supporting Azure infrastructure.

• Enforce GitOps practices — all infrastructure and platform config managed through Git and deployed via pipelines, never manually.

• Administer Databricks workspaces: cluster policies, Unity Catalog, access controls, and secret scopes — managed as code.

• Embed security into pipelines: secret scanning, least-privilege service principals, Key Vault integration, and network controls.

• Implement platform observability using Azure Monitor and Databricks system tables; serve as escalation point for platform incidents.

Key Skills

• GitHub Actions — CI/CD pipelines, multi-stage deployments, GitOps

• Terraform on Azure — modules, remote state, Databricks provider

• Databricks — workspaces, Unity Catalog, clusters, DABs, Databricks CLI

• Azure — VNets, Private Endpoints, Key Vault, Entra ID, ADLS Gen2,Storage Accounts

Python / Bash scripting, Azure CLI, GitHub CLI AI mandatory