Azure data factory developer with Snowflake exp

6+ years of ADF data flows/Snowflake. if you just worked on ADF pipelines, this is not for you.


An Azure Data Factory (ADF) Integration Developer is responsible for building, maintaining, and optimizing data pipelines and integration solutions using Microsoft Azure Data Factory. This role is key in data engineering and ETL (Extract, Transform, Load) processes in a cloud-based environment.


Key Responsibilities:

1. Design and Develop Data Pipelines
   
   
   • Build end-to-end data workflows using ADF (v2) for batch and real-time data processing.
     
     
   • Create and manage Linked Services, Datasets, Pipelines, Activities, and Triggers.
     
     
2. Data Integration
   
   
   • Integrate data from multiple sources like SQL Server, Azure Blob Storage, Azure Synapse, REST APIs, SAP, Salesforce, etc.
     
     
   • Handle structured and unstructured data using Data Flows, Mapping Data Flows, or custom transformations.
     
     
3. ETL/ELT Development
   
   
   • Implement data transformations using Azure Data Flows, Stored Procedures, or Azure Functions.
     
     
   • Optimize performance and cost using best practices.
     
     
4. Monitoring and Troubleshooting
   
   
   • Set up pipeline monitoring, alerts, and logs using ADF Monitoring and Azure Monitor.
     
     
   • Debug failures and optimize pipeline performance.
     
     
5. CI/CD and DevOps
   
   
   • Use Azure DevOps or Git integration for version control, build, and release pipelines.
     
     
   • Implement ARM templates for infrastructure as code (IaC).
     
     
6. Security and Governance
   
   
   • Manage access through Azure RBAC, Key Vault, and Managed Identity.
     
     
   • Ensure compliance and data security standards.
     
     
7. Collaboration
   
   
   • Work closely with Data Architects, Business Analysts, and BI developers.
     
     
   • Translate business requirements into technical solutions.
     
     

️ Required Skills and Technologies:

• Azure Data Factory
  
  
• Azure Synapse Analytics, Azure SQL
  
  

This is a remote position.