Job Title: Data Engineer Location: Chicago, IL (onsite) Duration: 12 Months (Possible Extension) Job ID: 24-31812
US Citizens, GC holders preferred, NO third party corp to corp accepted for this job
Key Responsibilities
Design & Development: Develop and optimize scalable, reliable, and secure data pipelines and platforms using Azure Data Services.
Data Integration: Integrate data from various sources, ensuring high data quality and availability for analysis.
Collaboration: Work closely with cross-functional teams, including Data Scientists, Analysts, and DevOps, to understand data requirements and deliver solutions.
Automation: Leverage Python 3.x to automate data workflows and ensure efficient handling of large datasets.
Version Control: Use Git/GitHub for version control, collaboration, and deployment of data solutions.
AWS Exposure: Apply knowledge of AWS services for hybrid cloud environments and data migrations when needed.
Performance Monitoring: Monitor, troubleshoot, and optimize data systems for performance and reliability
Required Qualifications
Proficiency in Python 3.x for data engineering tasks and automation.
Hands-on experience with Azure Data Services, such as Azure Data Factory, Azure Databricks, and Azure SQL.
Familiarity with AWS services like S3, Lambda, or Redshift is a plus.