Analysis Skills, Application Programming Interface (API), Atlassian JIRA, Customer Relationship Management (CRM), Data Management, Data Processing, Data Quality, ERP (Enterprise Resource Planning), High Availability, High Reliability, Microsoft Product Family, SQL (Structured Query Language), Scalable System Development, Scripting (Scripting Languages), Structured Data, System Integration (SI), Unstructured Data, Writing Skills
Title: Data Developer
Location: Charlotte, NC 28202 (Hybrid)
Duration: 12 Months
Pay Rate: $55.00 - $62.00/- on W2
Kindly share your most updated resume.
Roles and Responsibilities:
Develops scripts, processes, and tools to ingest, transform, and deliver data in a MS Fabric environment to support analytics and reporting needs.
Lakehouse Architecture & Platform Engineering
Design, build, and maintain scalable lakehouse architecture in Microsoft Fabric and OneLake
Ensure high availability, reliability, and performance of data platforms
Data Pipelines & Ingestion
Build and maintain end-to-end data pipelines for ingestion, transformation, and serving
Develop scalable ingestion frameworks for batch and real-time sources (APIs, databases, event streams)
Integrate enterprise systems (Jira, ERP, CRM, flat files, streaming sources)
Data Processing & Transformation
Develop and execute large-scale Spark jobs (batch and streaming)
Author and maintain notebooks (PySpark, SQL) for transformation and analysis
Implement data cleansing, enrichment, and transformation logic
Data Quality & Integration
Build ingestion logic for structured, semi-structured, and unstructured data
Implement data validation and quality controls
Data Enablement
Deliver analytics-ready datasets for Power BI and downstream consumption
Skill Requirements
Microsoft Fabric (Lakehouse, OneLake, Pipelines, Notebooks)
Apache Spark (PySpark, Spark SQL)
SQL
Python
Delta Lake / Delta Tables
Data Pipeline Design (ETL / ELT)
API & Streaming Data Integration