Azure data factory developer with Snowflake exp

CLOUDSCOUTS SOFTWARE SOLUTIONS LLC

Frisco, TX(remote)

JOB DETAILS
SKILLS
ARM (Advanced RISC Machine), Application Programming Interface (API), Architectural Analysis, Best Practices, Business Analysis, Business Intelligence, Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Cost Control, Data Management, Data Mapping, Data Processing, Data Sets, Database Extract Transform and Load (ETL), Debugging Skills, DevOps, Git, Identify Issues, Identity Data Management, Information/Data Security (InfoSec), Maintain Compliance, Microsoft SQL Server, Microsoft Windows Azure, Performance Tuning/Optimization, REST (Representational State Transfer), Requirements Management, SAP, SQL (Structured Query Language), Salesforce.com, Security Compliance, Snowflake Schema, Source Code/Configuration Management (SCM), Stored Procedures, Structured Data, Unstructured Data
LOCATION
Frisco, TX
POSTED
23 days ago
6+ years of ADF data flows/Snowflake. if you just worked on ADF pipelines, this is not for you.


An Azure Data Factory (ADF) Integration Developer is responsible for building, maintaining, and optimizing data pipelines and integration solutions using Microsoft Azure Data Factory. This role is key in data engineering and ETL (Extract, Transform, Load) processes in a cloud-based environment.


Key Responsibilities:


  1. Design and Develop Data Pipelines

    • Build end-to-end data workflows using ADF (v2) for batch and real-time data processing.

    • Create and manage Linked Services, Datasets, Pipelines, Activities, and Triggers.

  2. Data Integration

    • Integrate data from multiple sources like SQL Server, Azure Blob Storage, Azure Synapse, REST APIs, SAP, Salesforce, etc.

    • Handle structured and unstructured data using Data Flows, Mapping Data Flows, or custom transformations.

  3. ETL/ELT Development

    • Implement data transformations using Azure Data Flows, Stored Procedures, or Azure Functions.

    • Optimize performance and cost using best practices.

  4. Monitoring and Troubleshooting

    • Set up pipeline monitoring, alerts, and logs using ADF Monitoring and Azure Monitor.

    • Debug failures and optimize pipeline performance.

  5. CI/CD and DevOps

    • Use Azure DevOps or Git integration for version control, build, and release pipelines.

    • Implement ARM templates for infrastructure as code (IaC).

  6. Security and Governance

    • Manage access through Azure RBAC, Key Vault, and Managed Identity.

    • Ensure compliance and data security standards.

  7. Collaboration

    • Work closely with Data Architects, Business Analysts, and BI developers.

    • Translate business requirements into technical solutions.

️ Required Skills and Technologies:


  • Azure Data Factory

  • Azure Synapse Analytics, Azure SQL


This is a remote position.

About the Company

C

CLOUDSCOUTS SOFTWARE SOLUTIONS LLC