Senior Data Engineer

Job Summary
We are seeking a highly skilled and hands-on Senior Data Engineer Consultant with strong experience in Snowflake, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), SQL, and Python.

The ideal candidate will be responsible for designing, developing, and deploying scalable enterprise data pipelines and data products. This role requires strong technical expertise, end-to-end ownership, problem-solving capabilities, and the ability to deliver high-quality solutions in a fast-paced enterprise environment.

Key Responsibilities

• Design, develop, test, review, and support enterprise data pipelines using Snowflake, Azure Data Factory, Azure Data Lake Storage, SQL, and Python.

• Build and optimize Bronze, Silver, and Gold data layers using scalable ETL/ELT processes.

• Develop data models, pipeline orchestration, and data quality frameworks.

• Translate business requirements into production-ready technical solutions.

• Take end-to-end ownership of data engineering projects, from solution design and development through deployment and production support.

• Implement automated testing, CI/CD pipelines, DevSecOps, DataOps, monitoring, audit controls, and pipeline observability.

• Troubleshoot UAT and production issues, perform root-cause analysis, and implement permanent solutions.

• Develop reusable engineering patterns, best practices, and technical documentation.

• Collaborate with architects, product owners, engineers, and business stakeholders within Agile teams.

• Leverage AI-assisted development tools to design, build, code, and review production-grade data pipelines.

Required Technical Skills

1. Cloud Data Platforms

• Snowflake

• Azure Data Factory (ADF)

• Azure Data Lake Storage (ADLS)

2. Programming & Data Engineering

• Advanced SQL

• Python

• ETL/ELT development

• Data pipeline development and orchestration

3. Data Architecture & Modeling

• Data Warehousing

• Dimensional Data Modeling

• Medallion Architecture (Bronze, Silver, Gold)

4. Performance & Operations

• Performance Tuning and Optimization

• Data Quality Management

• Pipeline Monitoring and Observability

• Production Support and Troubleshooting

5. DevOps & Delivery

• Git

• CI/CD Pipelines

• Automated Testing

• Agile/Scrum Methodologies

Experience & Delivery Requirements

• 10+ years of hands-on experience in Data Engineering.

• Proven experience delivering production-grade data pipelines and enterprise data products.

• Ability to work independently and manage technical risks, dependencies, and project deliverables.

• Strong problem-solving and analytical skills.

• Excellent communication and stakeholder management abilities.

• Demonstrated focus on automation, scalability, maintainability, and business value.

• Ability to work effectively in a fast-paced, global working environment with minimal supervision.

Preferred / Good-to-Have Skills

• Power BI and Semantic Data Modeling.

• Experience with analytics enablement and reporting solutions.

• Familiarity with Jira, Azure DevOps, ServiceNow, Control-M, or equivalent tools.

• Experience with AI-assisted development, Agentic Workflows, and modern Data Product Architectures.

• Experience working with commercial, customer, quality, field-service, or operational reporting data products.

Ideal Candidate Profile

The ideal candidate should be a hands-on Senior Data Engineer with strong expertise in Snowflake, Azure Data Factory, Azure Data Lake Storage, Advanced SQL, and Python.

Candidates should have proven experience building scalable ETL/ELT pipelines, implementing Medallion Architecture, optimizing data platforms, and managing end-to-end production data engineering solutions.

Please share your updated resume on email : akriti.soni@applabsystems.com