| Description: | Position Title: Fabric Developer / Sr. Data Engineer Location: Phoenix, AZ (Onsite 5 days) Years of Experience: 8+ years Responsibilities: " Builds and maintains ELT/ETL pipelines using Microsoft Fabric tools, enabling efficient data ingestion from multiple resources. " Applies transformations, cleanses, and enriches data to ensure it is ready for analyzing and reporting " Handles large datasets, optimizing storage and retrieval for performance. " Implements automation for data processing and integration workflows, reducing manual intervention " Works with Platform Architects to ensure infrastructure supports data requirements. " Partners with Report developers to ensure that data is in a usable format and ready for analysis. " Ensuring code reusability and parameterization " Focuses on creating interactive, intuitive reports and dashboards using Microsoft Fabric's reporting tools. Qualifications: " Data Factory (in Fabric): Designing and orchestrating data ingestion and transformation pipelines (ETL/ELT). " Data Engineering Experience (Spark): Using Notebooks (PySpark, Spark SQL, Scala) and Spark Job Definitions for complex data processing, cleansing, enrichment, and large-scale transformations directly on OneLake data. " Lakehouse Items: Creating and managing Lakehouse structures (Delta tables, files) as the primary landing and processing zone within OneLake. " OneLake / ADLS Gen2: Understanding storage structures, Delta Lake format, partitioning strategies, and potentially managing Shortcuts. " Monitoring Hubs: Tracking pipeline runs and Spark job performance. " Core Responsibilities (Fabric Context): Building ingestion pipelines from diverse sources; implementing data cleansing and quality rules; transforming raw data into curated Delta tables within Lakehouses or Warehouses; optimizing Spark jobs and data layouts for performance and cost; managing pipeline schedules and dependencies; ensuring data security and governance principles are applied to pipelines and data structures. " Excellent Communicator and collaboration skills " Bachelor s degree in Computer Science, Engineering, or a relevant field " Azure/AWS Cloud Certifications will be a plus " Experience with Manufacturing domain will be a plus. " Should be self-driven and be able to drive the projects to delivery |
|---|---|
| Years of Experience: | 9.00 Years of Experience |
Since 1996, RJT has provided successful SAP, Oracle, and IT consulting solutions and staffing services to clients around the world. The new Apolis brings you the same personalized service fortified with a greater array of IT solutions, global expertise, and cost-management strategies.
We are a global IT consultancy that seamlessly integrates experts and leading-edge solutions into your organization so you can focus on what really matters.