Job Description
Location: Chicago, IL. Hybrid 3 days per week.
Duration: 6 months
Role Descriptions: Key Responsibilities Pipeline Development Design| implement| and optimize scalable ETL/ELT pipelines using Databricks (PySpark| SQL| Delta Lake) to ingest structured and semi structured data from multiple sources (APIs| databases| streaming). Data Warehousing Build and maintain cloud data warehouse solutions (Snowflake / Azure Synapse) design star schemas| fact/dimension tables| and aggregate tables for high performance reporting. Data Modeling Create logical and physical data models for operational and analytical use cases; implement SCD Type 2| slowly changing dimensions| and data vault methodologies where appropriate. Performance Tuning Optimize Spark jobs| SQL queries| and data partitioning strategies to handle petabyte scale data with low latency. Governance & Quality Implement data quality checks| monitoring| and lineage using tools like Great Expectations or custom frameworks; enforce data governance policies (GDPR/CCPA). Collaboration Partner with data analysts| product managers| and engineers to translate business requirements into technical data solutions. CI/CD & Automation Automate deployment of data pipelines using Azure DevOps or GitHub Actions; maintain infrastructure as code (Terraform) for data resources.
Duration: 6 months
Role Descriptions: Key Responsibilities Pipeline Development Design| implement| and optimize scalable ETL/ELT pipelines using Databricks (PySpark| SQL| Delta Lake) to ingest structured and semi structured data from multiple sources (APIs| databases| streaming). Data Warehousing Build and maintain cloud data warehouse solutions (Snowflake / Azure Synapse) design star schemas| fact/dimension tables| and aggregate tables for high performance reporting. Data Modeling Create logical and physical data models for operational and analytical use cases; implement SCD Type 2| slowly changing dimensions| and data vault methodologies where appropriate. Performance Tuning Optimize Spark jobs| SQL queries| and data partitioning strategies to handle petabyte scale data with low latency. Governance & Quality Implement data quality checks| monitoring| and lineage using tools like Great Expectations or custom frameworks; enforce data governance policies (GDPR/CCPA). Collaboration Partner with data analysts| product managers| and engineers to translate business requirements into technical data solutions. CI/CD & Automation Automate deployment of data pipelines using Azure DevOps or GitHub Actions; maintain infrastructure as code (Terraform) for data resources.
Numbers & Facts
| Location | Chicago, IL |
| Industry | Computer/IT Services |
| Company Size | 500 to 999 employees |
| Year Founded | 1990 |
| Website | http://q1tech.com/ |
About Company
Q1 consists of experienced and recognized experts providing the capability to respond to market demand in order to provide professional services for our clients including Enterprise software implementations, application integration and technical / functional support.
Q1 has steadily grown into a Quality IT services and solutions organization with the average experience of our team being over 10 years. We have continuously met or exceeded client expectations by delivering professional services and project implementations on time and under budget to help clients truly recognize return on investment.
Skills
- Application Programming Interface (API)unmatched
- Automationunmatched
- Channel Strategiesunmatched
- Cloud Computingunmatched
- Continuous Deployment/Deliveryunmatched
- Continuous Integrationunmatched
- Data Analysisunmatched
- Data Managementunmatched
- Data Modelingunmatched
- Data Partitioningunmatched
- Data Qualityunmatched
- Data Warehousingunmatched
- Database Designunmatched
- Database Extract Transform and Load (ETL)unmatched
- DevOpsunmatched
- GitHubunmatched
- Microsoft Windows Azureunmatched
- Operational Auditunmatched
- Performance Analysisunmatched
- Performance Tuning/Optimizationunmatched
- Requirements Managementunmatched
- SQL (Structured Query Language)unmatched
- Snowflake Schemaunmatched
- Star Schemaunmatched
- Structured Dataunmatched
- Use Casesunmatched
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesFree resume builder
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder