Databricks engineer contractor

Deloitte Touche Tohmatsu Ltd

NY

JOB DETAILS
SALARY
$65–$75 Per Hour
SKILLS
Accounts Receivable, American National Standards Institute (ANSI), Apache Kafka, Automation, Centers for Disease Control and Prevention (CDC), Continuous Deployment/Delivery, Continuous Integration, Data Collection, Data Management, Data Modeling, Data Processing, Data Quality, Data Sets, Database Extract Transform and Load (ETL), Git, GitHub, Healthcare, Microsoft Windows Azure, Operational Support, Performance Modeling, Performance Tuning/Optimization, Pharmacy, Python Programming/Scripting Language, SQL (Structured Query Language), Scalable System Development, Software Engineering, Source Code/Configuration Management (SCM), Usability Engineering
LOCATION
NY
POSTED
6 days ago

Position Summary

Contractor

Remote

Work you'll do

Position Summary

We are seeking a Databricks Engineer Contractor to support data engineering initiatives in the healthcare domain. This role focuses on building and supporting scalable data solutions that enable platform modernization and ongoing operational support. The contractor will develop, optimize, and maintain data pipelines and data products using Databricks and Azure-based tools. Experience with healthcare and pharmacy data environments will support success in this assignment.

Work you'll do

The service you will provide the Deloitte project team as a Databricks Engineer Contractor will include:

  • Build data pipelines and data products using Databricks, PySpark, Python, and American National Standards Institute Structured Query Language (ANSI SQL).
  • Develop bronze, silver, and gold data layers using Delta Lake and Medallion Architecture concepts.
  • Support batch and event-driven data processing using Apache Kafka and other streaming patterns.
  • Create and maintain workflow orchestration and deployment processes using tools such as Prefect, GitHub Actions, and Azure Pipelines.
  • Perform data modeling, pipeline tuning, and catalog configuration to support data quality, platform performance, and data usability.

Qualifications

Required:

  • 6+ years of experience with Databricks, including notebooks, jobs, workflows, Delta tables, and workspace utilities.
  • 6+ years of experience with PySpark for data ingestion, transformation, and pipeline development.
  • 6+ years of experience with Git and GitHub for version control, branch management, pull requests, and code promotion.
  • 6+ years of experience with American National Standards Institute Structured Query Language (ANSI SQL) for joins, aggregations, window functions, and query tuning.
  • 3+ years of experience with Python for data engineering, automation, and pipeline support.
  • Experience building and supporting extract, transform, and load (ETL) or extract, load, and transform (ELT) pipelines in Microsoft Azure environments.
  • Experience supporting healthcare or pharmacy data platforms, including claims, operational, or event-driven datasets.

Preferred:

  • 3+ years of experience with Apache Kafka for event streaming and message-based data processing.
  • 3+ years of experience with Azure Data Factory for pipeline orchestration and data movement.
  • Experience with Delta Lake and Medallion Architecture in Databricks environments.
  • Experience with workflow orchestration tools such as Prefect.
  • Experience with GitHub Actions or Azure Pipelines for continuous integration and continuous deployment.
  • Experience with change data capture (CDC), data modeling, and performance tuning for enterprise data platforms.

The expected pay range for this contract assignment is $65 - $75 per hour.  The exact pay rate will vary based on skills, experience, and location and will be determined by the third-party whose employees provide services to Deloitte.

Candidates interested in applying for this opportunity must be geographically based in the United States and must be legally authorized to work in the United States without the need for employer sponsorship.

We do not accept agency resumes and are not responsible for any fees related to unsolicited resumes.

Deloitte is not the employer for this role.

This work is contracted through a third-party whose employees provide services to Deloitte.

#LI-AR8

#Remote

Expected Work Schedule

Approximate hours per week

About Deloitte

Our inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It makes Deloitte one of the most rewarding places to work.

About the Company

D

Deloitte Touche Tohmatsu Ltd