Minimum Mandatory Skills ADF, Data Bricks
Desired Skills Python, PySpark
Key Responsibilities:- Design and implement ETL/ELT pipelines using Azure Data Factory.
- Develop and optimize data processing workflows in Azure Databricks using PySpark.
- Integrate data from multiple sources into a unified data platform.
- Ensure data quality, security and compliance across all processes.
- Collaborate with data architects, analysts and business teams to deliver reliable data solutions.
- Monitor and troubleshoot data pipelines for performance and reliability.
- Implement best practices for data governance, metadata management and data lineage.
Required Skills & Qualifications:- 6–8 years of experience in data engineering and data platform development.
- Strong hands-on experience with Azure Data Factory, Azure Databricks and PySpark.
- Proficiency in SQL and working with relational databases.
- Experience with data modeling, data warehousing and big data processing.
- Familiarity with Azure ecosystem (Data Lake, Synapse, Key Vault, etc.).
- Strong problem-solving and debugging skills.