The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveraging Databricks, Python, ETL, DevOps. This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives.
Key Responsibilities
Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data.
Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
Implement data governance, security, and compliance standards.
Automate workflows using Python scripting and CI/CD pipelines.
Troubleshoot and resolve issues in data ingestion, transformation, and storage.
Required Skills & Experience
8+ years in data engineering or related roles.
Expert-level Python programming for data processing and automation.
Hands-on experience with Databricks and Delta Lake.
Strong knowledge of Azure Data Factory, Data Lake, and Synapse (or equivalent cloud platforms).
Proficiency in SQL and performance tuning.
Familiarity with DevOps practices, CI/CD, and infrastructure-as-code tools.
Experience with data migration and cloud-native architectures.
Excellent problem-solving and communication skills
Numbers & Facts
Location
Chicago, IL
Industry
Other/Not Classified
Company Size
100 to 499 employees
Skills
Automationunmatched
Business Intelligenceunmatched
Cloud Architectureunmatched
Cloud Computingunmatched
Communication Skillsunmatched
Continuous Deployment/Deliveryunmatched
Continuous Integrationunmatched
Data Lakeunmatched
Data Managementunmatched
Data Migrationunmatched
Data Processingunmatched
Data Warehousingunmatched
Database Extract Transform and Load (ETL)unmatched
DevOpsunmatched
Identify Issuesunmatched
Information/Data Security (InfoSec)unmatched
Microsoft Windows Azureunmatched
Performance Tuning/Optimizationunmatched
Problem Solving Skillsunmatched
Python Programming/Scripting Languageunmatched
Regulatory Complianceunmatched
SQL (Structured Query Language)unmatched
Scalable System Developmentunmatched
Software Engineeringunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.