Databricks Architect
Atlanta GA
Onsite
Responsibilities:
- Design, build, and optimize enterprise-scale Databricks and data lakehouse architectures
- Develop and maintain data pipelines using Apache Spark, Delta Lake, and related technologies
- Collaborate with data engineers, analysts, and business stakeholders to define technical requirements
- Establish best practices for data governance, security, and performance tuning within Databricks
- Lead cloud data platform integrations across AWS, Azure, or GCP environments
- Provide technical guidance and mentorship to junior data engineering team members
- Monitor, troubleshoot, and continuously improve platform reliability and efficiency
Requirements:
- 5+ years of experience in data architecture, data engineering, or a related field
- Hands-on expertise with Databricks, Apache Spark, and Delta Lake
- Proficiency in Python, Scala, or SQL for large-scale data processing
- Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform
- Strong understanding of data lakehouse, data warehouse, and ETL/ELT design patterns
- Databricks Certified Associate or Professional certification is a plus
- Excellent communication skills with the ability to translate complex technical concepts to stakeholders