Data Engineer – SQL to Microsoft Fabric Modernization/Migration
100% remote
This is a 10-week project (that is about 2.5 months)
We are targeting October 12th or 19th as a start date
Strong Communication required
Must provide LinkedIn Profile
Responsibilities:
Take existing SQL stored procedures, transforming to fabric notebooks and those will create the silver tables in the Lakehouse in fabric, and they should match 1 to 1 SQL tables on PREM
Creating orchestration framework using data pipelines in fabric
Must do validate artifacts - reconciliation results, expectance evidence, making sure the tables match 1 to 1
Build out validation tests that can consistently run day in and day out
Will be building silver layer in the medallion architecture (will be in a solely isolated environment) - bronze is outside of scope and gold is beyond their score
Creating technical documentation to cover what they have done -this is what we did and how
Requirements:
5-7 years of experience (SQL, T-SQL, Spark)
Fabric (1-2 years minimum)
Very strong SQL and T-SQL (understand stored procedures, understand SQL, taking that SQL and migrating it to fabric notebooks)
PySpark
Spark SQL
Understand data flows in Fabric, data pipelines, understand what a Lakehouse is an how to use it
What a medallion architecture will be primarily in the silver layer
Some understanding the orchestration and scheduling in fabric
Nice to have is experience using metadata framework
Since 1996, RJT has provided successful SAP, Oracle, and IT consulting solutions and staffing services to clients around the world. The new Apolis brings you the same personalized service fortified with a greater array of IT solutions, global expertise, and cost-management strategies.
We are a global IT consultancy that seamlessly integrates experts and leading-edge solutions into your organization so you can focus on what really matters.
Skills
Communication Skillsunmatched
Data Managementunmatched
LinkedInunmatched
Metadataunmatched
Microsoft Transact-SQL (T-SQL)unmatched
Reconciliationunmatched
SQL (Structured Query Language)unmatched
Stored Proceduresunmatched
Technical Writingunmatched
Validation Testingunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.