Required Technical Skills & Certifications:
Core Platforms: Databricks (Lakehouse, Unity Catalog, Delta Live Tables, Workflows, Serverless SQL)
Languages: PySpark, SQL, Python, Scala
Cloud Platforms: Azure (preferred) or AWS (Data Lake, Event Hubs, IAM, secure networking)
Data Ops: Git, CI/CD (Azure DevOps / GitHub Actions), Terraform, dbt
Valued Credentials:Databricks Certified Solutions Architect
Databricks Certified Data Engineer Professional
Azure Solutions Architect Expert / AWS Certified Solutions Architect Professional
Core Key Roles & Responsibilities:
1. Principal Databricks Solution Architect
Role: Define the enterprise Lakehouse architecture, multi-region database strategies, and Unity Catalog governance frameworks.
Key Focus: Establish enterprise security baselines, network isolation, and high-performance clustering.
Experience: 10+ years in data architecture; 4+ years of dedicated Databricks platform design. Deep knowledge of Terraform, hybrid-cloud networking, and enterprise data security.
2. Technical Project Manager (TPM) / Scrum Master
Role: Oversee the agile sprint delivery of the Databricks program, manage sprint backlogs, and coordinate cross-regional deployments.
Key Focus: Drive collaboration between the engineering team and client business units, manage risk, and coordinate logistical/travel schedules across field offices.
Experience: 6+ years in PM/Scrum Master roles; 3+ years managing large-scale cloud data, analytics, or Databricks initiatives. CSM, PSM, or PMP certified.
3. Data & Tech Lead
Role: Lead dedicated engineering streams, perform code reviews, enforce software engineering standards, and mentor senior developers.
Key Focus: Bridge the gap between high-level architectural designs and hands-on coding.
Experience: 7+ years in Data Engineering; 3+ years in a technical leadership or mentoring role. Expert-level PySpark, SQL, and Delta Lake skills.
4. Senior Databricks Engineer / Developer
Role: Write clean, robust, and highly optimized PySpark and SQL code to build end-to-end batch and streaming pipelines.
Key Focus: Transform unstructured IoT, SCADA, and ERP data into curated Delta Lake tables (Bronze, Silver, Gold).
Experience: 5+ years in data engineering; 3+ years of daily, production-grade Databricks and PySpark experience. Expert in Delta Live Tables (DLT) and Spark Streaming.
5. DevSecOps & MLOps Engineer
Role: Automate the infrastructure provisioning, CI/CD pipelines, and machine learning models.
Key Focus: Infrastructure as Code (Terraform), Git, automated testing (pytest), and model tracking with MLflow.
Experience: 5+ years in DevOps/MLOps roles with deep knowledge of Databricks asset bundles, Azure DevOps/GitHub Actions, and secure networks.
Are you ready to build the future of energy analytics?
We are launching a massive, multi-year digital transformation campaign for a major player in the global Oil & Gas sector. To execute this initiative, we are building an elite, high-performing squad of 16–18 Databricks Consultants to design, develop, and operationalize a cutting-edge unified Lakehouse Platform.
We are actively recruiting for the following key positions:
These roles will tackle some of the most complex, high-scale engineering challenges in the world—integrating high-frequency SCADA/IoT telemetry, predicting equipment failures, managing remote field asset data, and standardizing data across multi-region environments.
Who You Are:
You are a seasoned data professional who thrives at the intersection of complex cloud technologies and physical-world industry operations.
You have deep, hands-on experience with the Databricks Lakehouse ecosystem (Unity Catalog, Spark, Delta Lake, DLT).
You are flexible, adventurous, and eager to work on-site at major energy hubs across the United States, including Texas, Alaska, North Dakota, and Pennsylvania.
How to Apply:
If you are a top-notch Databricks consultant looking to make a massive impact in the global energy sector, we want to hear from you.
Please submit your updated resume, highlighting your Databricks certifications, Oil & Gas / Energy experience, and your availability/preferences for travel and relocation to PA, AK, ND, and TX.
Our recruitment team is actively reviewing applications and will schedule initial technical screening calls within 48 hours.