Job Title: Azure Databricks Architect
Location: Houston, TX (On-site)
Employment Type: Contract (W2 through ZipStaff)
About the Opportunity
ZipStaff is seeking an experienced Azure Databricks Architect with Oil & Gas domain experience to lead the design, development, and optimization of enterprise-scale data platforms and analytics solutions.
This role sits within a major energy organization’s Azure-based data analytics ecosystem. You will drive data engineering best practices, architect scalable Lakehouse solutions, mentor team members, and partner with business stakeholders to deliver high-performance, secure, and governed data platforms.
What You’ll Do:
- Lead the architecture and development of scalable data pipelines and ETL/ELT frameworks using Azure Databricks and PySpark.
- Design and optimize data ingestion, transformation, and consumption layers.
- Architect data models, data dictionaries, and reusable data products.
- Implement data governance, quality, security, and compliance standards.
- Optimize Spark workloads, Databricks jobs, and overall platform performance.
- Collaborate with business users, data scientists, and cross-functional teams to translate requirements into technical solutions.
- Mentor and guide data engineers and junior team members.
- Drive CI/CD automation and DevOps best practices for data platforms.
- Support Data Lakehouse architecture and enterprise analytics initiatives.
Required Qualifications:
- 10+ years of experience in Data Engineering or Data Platform delivery.
- Strong hands-on expertise with Azure Databricks and enterprise-scale implementations.
- Proficiency in PySpark / Apache Spark, Python, and SQL / T-SQL.
- Experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Delta Lake.
- Solid experience with data modeling, data warehousing, and performance tuning.
- Experience driving CI/CD, Azure DevOps, and automation frameworks for data platforms.
- Strong background in data governance, security, and compliance.
- Proven ability to lead Azure-based cloud data transformation programs.
- Experience mentoring teams and establishing technical standards.
- Oil & Gas industry experience required.
- Ability to work on-site in Houston, TX.
Preferred Qualifications:
- Experience with Unity Catalog.
- Exposure to Airflow, Power BI, or DataOps/MLOps practices.
- Strong stakeholder management and client-facing communication skills.
- Deep experience with Lakehouse architecture.
About ZipStaff
ZipStaff partners with leading organizations to connect skilled data and cloud professionals with high-impact contract opportunities. We focus on quality matches and long-term success.
To apply, please submit your resume highlighting your Azure Databricks architecture experience and Oil & Gas background.