Access Control, Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Architectural Design, Automation, Best Practices, Cloud Computing, Communication Skills, Cross-Functional, Documentation, Identify Issues, Leadership, Network Routing, Security Infrastructure, Single Sign-On (SSO), Software Engineering, Technical Leadership, Technical Writing, Writing Skills
Our client is seeking an experienced Databricks Platform Architect to design, deploy, configure, and secure enterprise Databricks environments on AWS. This role is primarily focused on Databricks platform architecture, Infrastructure-as-Code (Terraform), and enterprise platform engineering. Strong AWS networking expertise is beneficial but is not the primary focus of the role.
Responsibilities & Qualifications
- Design, configure, deploy, and secure Databricks platforms on AWS, including both Classic and Serverless Workspaces
- Architect enterprise Databricks environments, including workspace configuration, identity integration, cluster policies, secret management, and platform governance
- Author and maintain Terraform modules to provision and manage Databricks and AWS infrastructure using Infrastructure-as-Code (IaC)
- Implement secure platform architecture, including workspace isolation, IAM/SSO integration, cluster access controls, secret scopes, and secure connectivity patterns
- Partner with cloud, security, and platform engineering teams to design, validate, and deploy scalable Databricks solutions
- Produce architecture documentation, diagrams, standards, and operational runbooks
- Provide technical leadership, architecture guidance, and best practices for enterprise Databricks platform deployments
Required Skills
- 10+ years of experience in Cloud Platform Engineering, Data Platform Architecture, Infrastructure Engineering, or similar roles
- Deep hands-on experience with Databricks Platform Architecture, including deployment, configuration, security, and administration
- Experience designing and supporting both Classic and Serverless Databricks Workspaces
- Strong experience with Terraform and Infrastructure-as-Code (IaC)
- Experience with Databricks platform security, including:
- Workspace architecture
- Identity & SSO integration
- IAM integration
- Cluster policies
- Secret management / Secret Scopes
- Workspace isolation and governance
- Working knowledge of AWS infrastructure, including IAM, VPC, S3, PrivateLink, networking, routing, and identity integration required to deploy and support Databricks environments
- Strong troubleshooting, architecture, and technical documentation skills
- Excellent communication skills with the ability to work directly with customers, architects, and cross-functional engineering teams
Nice to Have
- Advanced AWS networking experience (VPC design, PrivateLink, Security Groups, NACLs, routing, etc.)
- Experience with Databricks security accreditation, governance, and compliance initiatives
- Experience building reusable Terraform modules and enterprise platform automation
- Experience leading architecture workshops and customer enablement sessions
E
Expert In Recruitment Solutions