Data Engineer ADF / Databricks / Snowflake

Job Details

• Job Title: Data Engineer – ADF / Databricks / Snowflake
• Location: Dallas, TX
• Duration: 6 months
• GBaMS ReqID: 10926596
• Experience Required: 10+ years
• Essential Skills: Data Engineer – ADF, Databricks, and Snowflake
• Keyword: Digital: Google Data Engineering

Key Skill Set

• Strong hands-on experience with Databricks for building scalable data pipelines.
• Strong knowledge of:
  • Delta Lake
  • Apache Spark
  • Databricks
• Advanced proficiency in:
  • SQL
  • Python
• Experience with SQL and Python for:
  • Data transformation
  • Data optimization
  • Data automation
• Experience with data visualization tools, including:
  • Tableau
  • Power BI
• Ability to deliver actionable business insights through data visualization.
• Solid understanding of healthcare data models.
• Experience working with:
  • Healthcare claims datasets
  • Clinical datasets
  • Healthcare data standards
  • Domain-specific compliance requirements
• Strong SAP Supply Chain Management domain expertise.
• Expertise in:
  • CI/CD pipelines
  • GitHub
  • Version control
  • Deployment best practices
• Experience with workflow orchestration tools, including:
  • Databricks Workflows
  • Apache Airflow
• Familiarity with Agile development methodologies.
• Experience using Jira for:
  • Sprint planning
  • Task tracking
  • Backlog management
• Exposure to ETL migration, specifically migrating DataStage jobs to Azure.
• Practical experience leveraging AI-assisted development tools for:
  • Code generation
  • Code optimization
  • Documentation
  • Developer productivity
• Ability to use AI tools to accelerate development and delivery.

Technical Skills

• Data Engineering: Azure Data Factory, Databricks, Snowflake, ETL/ELT
• Big Data: Apache Spark, Delta Lake
• Programming: Python, SQL
• Visualization: Tableau, Power BI
• Cloud: Microsoft Azure
• DevOps: CI/CD, GitHub, Version Control
• Orchestration: Databricks Workflows, Airflow
• ETL Migration: DataStage to Azure
• Enterprise Systems: SAP
• Project Management: Jira, Agile/Scrum
• AI: AI-Assisted Development, Code Generation, Code Optimization

Domain Skills

• Healthcare Data
• Claims Data
• Clinical Data
• Healthcare Compliance
• SAP Supply Chain Management
• Enterprise Data Engineering

Preferred Skills

• Advanced Databricks and Delta Lake development.
• Azure Data Factory pipeline development.
• Snowflake data engineering.
• Healthcare analytics and data platforms.
• SAP Supply Chain data integration.
• DataStage-to-Azure migration experience.
• AI-enabled software development and automation.