Job Title: Technology Lead Azure Databricks Data Engineer
Location: Chicago, IL 60604 (Hybrid/Onsite Day 1)
Duration: 6 Months (Contract)
Experience: 10+ Years
Start Date: Immediate
Interview Mode: Virtual
Relocation: Accepted (Must Work Onsite from Day 1)
Job Description
We are seeking an experienced Azure Databricks Data Engineer with 10+ years of IT experience and strong hands-on expertise in Azure Databricks, PySpark, SQL, and AI-driven Data Pipelines. The ideal candidate should have experience developing scalable data engineering solutions and supporting Machine Learning and Recommendation Systems.
Required Skills
10+ years of overall IT/Data Engineering experience.
Strong hands-on experience with Azure Databricks, PySpark, and SQL.
Expertise in designing, developing, and optimizing scalable data pipelines.
Experience supporting AI-driven data pipelines using Databricks.
Working knowledge of Machine Learning (ML) and Recommendation Systems.
Strong understanding of data processing, transformation, and performance optimization.
Excellent analytical, troubleshooting, and communication skills.
Key Responsibilities
Design and develop data engineering solutions using Azure Databricks, PySpark, and SQL.
Build and maintain scalable, AI-driven data pipelines.
Support ML and recommendation-based data processing requirements.
Collaborate with cross-functional teams to deliver reliable data solutions.
Mandatory Requirements
Must be authorized to work in the USA without sponsorship (Visa-independent candidates only).
Must be available to work from the Chicago client location starting Day 1.
Certifications: Not Required.