Senior Data Engineer - Microsoft Fabric / Data Factory (Ref: 5656)

• Designing, developing, and maintaining scalable data pipelines using Microsoft Fabric Data Factory, Azure Data Factory, and related Microsoft data engineering tools.
• Building and managing data integration workflows across cloud, on-premises, and hybrid environments.
• Developing ETL/ELT processes to ingest, transform, validate, and load data from multiple structured and semi-structured sources.
• Supporting modern data platform architecture using Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Dataflows Gen2, Pipelines, Notebooks, and related services.
• Designing and implementing data models for enterprise reporting, analytics, dashboards, and downstream business intelligence use cases.
• Writing and optimizing complex SQL queries, stored procedures, views, and scripts using SQL Server, T-SQL, Azure SQL, and related platforms.
• Monitoring pipeline performance, troubleshooting failures, resolving data quality issues, and improving reliability of automated data processes.
• Creating and maintaining technical documentation, data flow diagrams, source-to-target mappings, data dictionaries, and operational runbooks.
• Working with business analysts, BI developers, application teams, architects, QA teams, and project managers to support end-to-end data delivery.
• Supporting data governance, metadata management, lineage, access controls, security, and compliance requirements.
• Participating in performance tuning, capacity planning, data warehouse optimization, and production support activities.
• Supporting migration or modernization efforts from legacy ETL/data warehouse platforms to Microsoft Fabric and Azure-based data services.
• Providing technical leadership, mentoring, and guidance to junior data engineers and project team members.

• 12-15 years of overall IT experience, including substantial experience in data engineering, data warehousing, ETL/ELT development, database development, or analytics platform implementation.
• 7+ years of hands-on data engineering experience designing, building, and supporting enterprise data pipelines.
• 3+ years of hands-on experience with Azure Data Factory and/or Microsoft Fabric Data Factory, including pipeline development, orchestration, triggers, linked services/connections, parameterization, monitoring, and troubleshooting.
• Demonstrated experience with Microsoft Fabric or closely related Microsoft analytics platform services, such as:
  • Fabric Data Factory
  • OneLake
  • Lakehouse
  • Warehouse
  • Dataflows Gen2
  • Pipelines
  • Notebooks
  • Power BI integration
  • Data Activator or Real-Time Intelligence, where applicable
• Strong experience with SQL Server, T-SQL, Azure SQL Database, Azure Synapse, or Microsoft Fabric Warehouse.
• Experience designing and implementing data warehouses, data marts, dimensional models, normalized models, and analytics-ready datasets.
• Experience integrating data from multiple source systems, including APIs, flat files, relational databases, SaaS platforms, cloud storage, and enterprise applications.
• Experience with data quality validation, reconciliation, exception handling, audit logging, and error handling within data pipelines.
• Experience supporting production data pipelines, including monitoring, troubleshooting, root-cause analysis, and performance optimization.
• Strong understanding of cloud data architecture, data security, role-based access controls, data privacy, and compliance requirements.
• Experience preparing technical documentation, data mapping documents, ERDs, data flow diagrams, and deployment/support documentation.
• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, Engineering, Mathematics, or a related field. Equivalent qualifying experience may be considered depending on client requirements.

• Prior experience supporting government, public-sector, healthcare, education, transportation, utilities, or other highly regulated environments.
• Experience with State, county, city, or federal government data systems.
• Experience with public-sector procurement, reporting, compliance, eligibility, case management, licensing, permitting, financial, healthcare, or regulatory systems.
• Experience migrating legacy SSIS, SQL Server, or on-premises data warehouse environments to Microsoft Fabric or Azure data services.
• Experience with Power BI semantic models, DAX, reporting datasets, and BI/reporting integration.
• Experience with Python, PySpark, Spark SQL, or Fabric Notebooks.
• Experience with Azure DevOps, Git, CI/CD pipelines, release management, and deployment automation.
• Experience with Azure Data Lake Storage, Databricks, Synapse, Event Hubs, Logic Apps, Functions, Key Vault, Purview, or Microsoft Defender for Cloud.
• Experience with data governance, metadata management, data lineage, and cataloging tools such as Microsoft Purview.
• Experience with Agile, Scrum, Hybrid Agile, or Waterfall delivery environments.
• Experience mentoring technical teams or serving as a lead data engineer.

• Microsoft Certified: Fabric Analytics Engineer Associate
• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Power BI Data Analyst Associate
• Microsoft Certified: Azure Database Administrator Associate
• Microsoft Certified: Azure Solutions Architect Expert
• Microsoft Certified: Azure Developer Associate
• Microsoft Certified: Azure Administrator Associate
• Microsoft Applied Skills credentials related to Microsoft Fabric, Data Factory, Lakehouse, Data Warehouse, or Power BI

• Microsoft Fabric Data Factory
• Azure Data Factory
• Microsoft Fabric Lakehouse / Warehouse / OneLake
• Dataflows Gen2
• Fabric Pipelines
• Fabric Notebooks
• SQL Server / T-SQL
• Azure SQL Database
• Azure Synapse Analytics
• SSIS / SSRS / SSAS
• Power BI
• Python / PySpark / Spark SQL
• Data Lake / Lakehouse architecture
• ETL / ELT
• Data warehousing and dimensional modeling
• API and file-based data integration
• Data quality and validation
• Metadata, lineage, and governance
• Azure DevOps / Git / CI/CD
• Microsoft Purview
• Cloud security and access control

Estrada Consulting, Inc. (ECI) delivers technology-enabled services and solutions to clients all over the USA and British Columbia. We provide system integration, custom application development, data warehouse and business intelligence, project management, custom reporting solutions and consulting services to mid-size and large enterprises in all major industries. The Company headquarters is in Sacramento, California, and was established in year 2000. Visit http://www.estradaci.com/ to learn about our projects, managed services, awards and certifications delivering value for a range of businesses and government agencies.