Senior Cloud Engineer - Azure Infrastructure & Databricks Platform

Position Title: Senior Cloud Engineer - Azure Infrastructure & Databricks Platform

Location: US Remote

Basic Qualifications:

• 6 years in cloud infrastructure or platform engineering, with at least 4 years focused on Microsoft Azure.
• Expert-level, hands-on experience with Terraform.
• Demonstrable hands-on administration experience with Databricks.
• Deep working knowledge of Azure Networking & Security.
• Experience with ADLS Gen2 design and access control.
• Platform-side experience with Azure Data Factory.
• Strong automation and scripting skills with Python, PowerShell, and/or Bash.
• Sufficient working knowledge of Spark & SQL.

Required Skills:

• Infrastructure as Code with Terraform.
• Databricks Administration and technical partnership.
• Azure Networking & Security expertise.
• Data Lake Architecture experience.
• Azure Data Factory platform operations.
• Automation & Scripting proficiency.
• Spark & SQL Literacy.

Preferred Qualifications:

• Experience with Databricks Asset Bundles and Terraform Databricks provider.
• Experience leading a Unity Catalog migration.
• Azure Machine Learning, MLflow, or model-serving infrastructure experience.
• Experience with Kubernetes / AKS and containerized workloads.
• Experience with Policy as code and Event-driven infrastructure.
• Formal FinOps practice experience.
• Experience with multi-region or multi-tenant Databricks deployments.

Preferred Certifications:

• Databricks Certified Data Engineer Professional or Databricks platform administrator credential.
• Microsoft Certified: Azure Solutions Architect Expert (AZ-305).
• Microsoft Certified: Azure Administrator Associate (AZ-104).
• Microsoft Certified: DevOps Engineer Expert (AZ-400).
• HashiCorp Certified: Terraform Associate.

Role and responsibilities:

We are seeking a Senior Cloud Engineer to design, implement, and administer the Azure infrastructure behind our enterprise data and AI platform. This is a cloud infrastructure and platform engineering position centered on Azure Databricks, ADLS Gen2, Azure Data Factory, and Azure Machine Learning.

Job description:

You will own the platform foundation — infrastructure as code, network and identity architecture, compute governance, observability, and cost management — and partner closely with our Databricks administration, data engineering, and data science teams. Our group defines the platform standards and reference architectures those teams build within, which means depth in Databricks administration matters here as much as depth in Azure. You should be equally at home provisioning a workspace through Terraform and advising on Unity Catalog design, cluster policy, or identity federation.

This role suits an engineer who enjoys being the technical reference point for a platform: setting the architectural direction, partnering with adjacent teams on complex problems, and translating business requirements into the platform capabilities needed to support them.

• Infrastructure Ownership: Design, implement, and administer the Azure foundation the platform runs on.
• Databricks Platform Administration: Establish platform standards and serve as a senior technical partner on architecture, design decisions, and complex escalations.
• Role Scope: Collaborate with data engineering and data science teams, providing standards, architecture, and senior technical partnership.