Sr. Data Architect

Hybrid role 3X a week in office in Elk Grove, CA; no remote capabilities.

This is a direct hire opportunity.

Summary:

We’re looking for a Senior Data Architect to lead the design and optimization of our Databricks Lakehouse platform on GCP. In this role, you’ll guide a team of data engineers, own end‑to‑end data architecture, and build scalable pipelines that support analytics, reporting, and machine learning across the organization. This position requires deep Databricks expertise, strong leadership, and the ability to communicate data strategy to both technical and executive teams.

Responsibilities:

• Lead and mentor a high‑performing data engineering team
• Own Databricks architecture, including Spark, Delta Lake, and Lakehouse design
• Implement Unity Catalog for governance, access control, and lineage
• Optimize SQL workloads, Spark jobs, and overall platform performance
• Build scalable pipelines for structured, semi‑structured, and unstructured data
• Integrate Databricks workflows into CI/CD using Git and DevOps best practices
• Ensure strong data security, masking, encryption, and audit logging
• Partner with analysts, data scientists, and business leaders to deliver high‑impact data solutions

Qualifications:

• 10+ years in data engineering or data architecture
• Deep hands‑on experience with Databricks (GCP preferred), Spark, PySpark/Scala, and Delta Lake
• Strong cloud experience (GCP preferred; AWS/Azure acceptable)
• Experience with vector databases and embeddings for RAG/LLM retrieval
• Advanced SQL and data warehousing expertise
• Proven ability to optimize ETL jobs and cluster performance
• Strong background in data governance and security (Unity Catalog or similar)
• Leadership experience and excellent communication skills
• Agile team experience

Tech Stack:

• Databricks, Spark, Delta Lake, Unity Catalog, PySpark, Python, SQL, GCP Storage, Pub/Sub, vector databases, Git/GitLab, Jenkins, Terraform (plus), JIRA, Confluence, Looker Studio, Power BI.
• Databricks Data Engineer certification; experience with Kafka, Pub/Sub, Airflow, and BI tools.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.