Data Engineer ADF / Databricks / Qlik Replicate / Snowflake

Job Details

• Job Title: Data Engineer – ADF / Databricks / Qlik Replicate / Snowflake
• Location: Dallas, TX
• Duration: 6 months
• GBaMS ReqID: 10917262
• Experience Required: 10+ years
• Role Description: Data Engineer – ADF, Databricks, Qlik Replicate & Snowflake
• Essential Skills: Azure Data Factory, Databricks, Qlik Replicate, Snowflake

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using:
  • Azure Data Factory (ADF)
  • Azure Databricks
  • Snowflake
• Support enterprise data and analytics initiatives.
• Implement and manage real-time and batch data ingestion solutions using Qlik Replicate.
• Ensure reliable and efficient data movement across multiple platforms.
• Develop data transformation and ETL/ELT processes using:
  • PySpark
  • SQL
  • Databricks
• Optimize data pipelines for:
  • Performance
  • Scalability
  • Data quality
  • Reliability
• Collaborate with business and technical stakeholders to:
  • Understand data requirements
  • Design data models
  • Deliver robust data solutions
• Monitor, troubleshoot, and optimize data workflows.
• Follow best practices for:
  • Data governance
  • Data security
  • Cloud architecture

Required Technical Skills

• Strong hands-on experience with Qlik Replicate development.
• Strong experience with Azure Cloud services.
• Good knowledge of Snowflake.
• Strong expertise in creating ETL pipelines using:
  • Azure Data Factory
  • Azure Databricks
• Strong debugging capabilities for Qlik Replicate tasks.
• Strong knowledge of performance optimization.
• Sound knowledge of Azure Databricks.
• Good knowledge of SAP.
• Strong experience with:
  • ETL/ELT
  • Data ingestion
  • Data transformation
  • Data pipelines
  • Data integration
• Strong SQL and PySpark skills.

Domain Knowledge

• Supply Chain domain knowledge required.
• Healthcare domain knowledge required.
• Experience working with enterprise data and analytics environments.

Core Technologies

• Azure Data Factory (ADF)
• Azure Databricks
• Databricks
• Qlik Replicate
• Snowflake
• PySpark
• SQL
• Azure Cloud
• SAP
• ETL/ELT
• Data Pipelines
• Data Integration
• Data Modeling
• Batch Data Processing
• Real-Time Data Ingestion
• Performance Optimization
• Data Governance
• Data Security

Preferred / Desirable Skills

• Advanced Azure Data Engineering.
• Qlik Replicate task development and debugging.
• Snowflake data engineering.
• Databricks performance optimization.
• Supply Chain analytics and data solutions.
• Healthcare data solutions.

Keyword

• Digital: Google Data Engineering