Senior Azure Data Engineer

Job Title: Senior Azure Data Engineer
Location: Hamilton, NJ (Hybrid 4 days onsite)
Employment Type: Contract
Experience Level: 10+ years of experience

Job Overview

We are seeking a highly skilled Senior Azure Data Engineer to design, build, and optimize modern data platforms in an enterprise Azure environment. The ideal candidate will have strong hands-on experience with Databricks or Microsoft Fabric (preferred), with Snowflake exposure as a plus.
This role focuses on developing scalable, secure, and high-performance data solutions that support analytics, reporting, and AI/ML-enabled workloads. The position offers the opportunity to work at the intersection of data engineering, analytics, and applied AI while collaborating with cross-functional business and technical teams.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines and data models using Microsoft Fabric, Databricks, or Snowflake
• Architect and optimize lakehouse and data warehouse solutions for analytics and enterprise reporting
• Implement data governance best practices, including data quality, metadata management, lineage, and access controls
• Integrate Azure services such as Azure Data Factory (ADF), Synapse Analytics, Azure Functions, and Logic Apps
• Enable seamless Power BI integration, including semantic models and enterprise dashboards
• Build and maintain CI/CD pipelines and manage source control using Git-based DevOps workflows
• Collaborate with analytics, business, and AI teams to deliver data-driven solutions
• Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability
• Support and implement machine learning workflows using Azure ML, Databricks ML, or open-source frameworks
• Stay current with emerging technologies in data engineering, analytics, and AI

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field
• 10 years of hands-on experience in data engineering, analytics, or data platform development
• Strong experience with at least one of the following platforms:
  • Databricks (Apache Spark, PySpark, Delta Lake, notebooks) preferred
  • Microsoft Fabric (Lakehouse, Warehouse, Spark, Data Engineering pipelines, Power BI integration) preferred
  • Snowflake
• Advanced proficiency in SQL and Python (Scala or Java is a plus)
• Strong understanding of Apache Spark and distributed data processing concepts
• Experience with Azure Data Factory, Synapse Analytics, and related Azure services
• Exposure to machine learning frameworks such as scikit-learn, TensorFlow, or PyTorch
• Experience with Azure ML, Databricks ML, or similar ML platforms
• Solid knowledge of Azure cloud services, DevOps practices, and CI/CD pipelines

Technical Skills

• Advanced SQL and Python
• Apache Spark (PySpark) and Delta Lake
• Microsoft Fabric / Databricks / Snowflake
• Azure Data Factory (ADF), Synapse Analytics, Logic Apps
• Power BI, semantic models, and enterprise reporting
• CI/CD pipelines, Git, and DevOps workflows
• Applied ML and AI exposure using Azure or open-source tools

Soft Skills

• Strong communication and stakeholder collaboration skills
• Analytical mindset with excellent problem-solving abilities
• Ability to work cross-functionally in fast-paced environments
• High level of ownership, accountability, and adaptability to new technologies