Senior Data Engineer - Microsoft Fabric

PJ Dick-Trumbull-Lindy Group
  • Pittsburgh, PA
  • Full-time
  • Instant Apply
1 day ago

Job Description

Senior Data Engineer - Microsoft FabricPJ Dick, Trumbull, & The Lindy Group Hybrid | Pittsburgh (North Shore)Position OverviewWe are seeking an experienced Senior Data Engineer to design, build, and optimize the enterprise data platform that powers analytics, reporting, and AI initiatives across PJ Dick, Trumbull, and The Lindy Group.This role will lead the design and implementation of modern data solutions using Microsoft Fabric, Azure services, and industry best practices for data engineering. The ideal candidate will possess extensive experience developing large-scale data pipelines, ETL/ELT processes, data models, and analytics platforms that support business-critical decision making.You will work closely with business leaders, application developers, data analysts, and external partners to transform data into a strategic asset. This position offers the opportunity to shape the company's long-term data architecture.---What You Will DoMicrosoft Fabric Architecture & DevelopmentDesign, implement, and maintain enterprise data solutions using Microsoft Fabric.Build and manage Fabric Lakehouses, Warehouses, Semantic Models, and Data Factory Pipelines.Develop scalable data architectures that support reporting, analytics, machine learning, and AI initiatives.Optimize Fabric workloads for performance, scalability, governance, and cost management.ETL / ELT & Data PipelinesDesign, build, and maintain complex ETL and ELT pipelines that ingest data from ERP, project management, financial, operational, and external systems.Develop automated data integration processes utilizing Fabric Data Factory, Azure Data Factory, Spark notebooks, and APIs.Ensure data quality, reliability, lineage, and governance throughout the data lifecycle.Serve as a primary technical resource for diagnosing and resolving pipeline failures, data quality issues, and reporting discrepancies, often working backward from a broken output to identify root cause across ingestion, transformation, and delivery layers.Data Engineering & AnalyticsDesign and maintain enterprise data models that support operational and executive reporting.Transform structured and unstructured data into analytics-ready datasets.Collaborate with BI developers and analysts to build semantic models and Power BI reporting solutions.Establish standards for data architecture, metadata management, and master data management.Azure IntegrationIntegrate Fabric solutions with Azure SQL Database, Azure Storage, Cosmos DB, Azure Functions, API Management, and other Azure services.Secure data exchange processes utilizing Entra ID, Key Vault, and Azure networking services.Develop data ingestion frameworks from cloud, on-premises, SaaS, and third-party platforms.Governance & Operational ExcellenceWork with our security team to implement data governance, retention, and compliance requirements.Document architecture, operational procedures, and technical standards.Mentor team members and promote data engineering best practices across the organization.---Required QualificationsExperienceMinimum 7 years of professional Data Engineering experience supporting enterprise-scale environments.Minimum 1 years of hands-on Microsoft Fabric experience in production environments.Demonstrated experience designing and supporting large-scale data platforms and analytics ecosystems.Proven experience delivering end-to-end data engineering solutions from requirements through production deployment.Technical SkillsMicrosoft FabricDeep expertise with:Fabric Data FactoryFabric LakehousesFabric WarehousesSemantic ModelsOneLakeSpark NotebooksData PipelinesReal-Time AnalyticsDataflows Gen2Data EngineeringAdvanced SQL development and optimization.Strong ETL/ELT development experience.Experience working with large datasets and complex data transformations.Expertise in data modeling, dimensional modeling, and data warehousing methodologies.Experience building resilient, scalable, and automated pipelines.Experience converting non-relational or document-based data sources, including NoSQL and legacy platforms, into normalized relational schemas.Comfortable reverse-engineering data structures and tracing data discrepancies back to root cause in systems with limited or no formal documentation.AzureStrong experience with:Azure SQL DatabaseAzure Data FactoryAzure StorageAzure FunctionsAzure Key VaultAzure MonitorEntra IDDevelopment & AutomationStrong proficiency in Python.Experience with Spark and PySpark.Experience working with REST APIs and integration frameworks.Source control experience using Git, Azure DevOps, or Bitbucket.Experience implementing CI/CD for data engineering solutions.Business & Leadership SkillsAbility to translate business requirements into scalable technical solutions.Strong analytical and problem-solving skills.Excellent written and verbal communication skills.Experience working directly with both technical and non-technical stakeholders.Ability to manage multiple priorities and projects simultaneously.Ability to scope, estimate, and deliver against committed timelines, with proactive communication when priorities or scope shift.Comfortable operating in an iterative delivery model where business stakeholders remain engaged throughout the build and requirements evolve as the work takes shape.---Preferred QualificationsExperience with construction, engineering, manufacturing, or professional services organizations.Experience integrating ERP platforms such as CMiC or similar enterprise systems.Experience with Power BI administration and enterprise reporting environments.Knowledge of data governance frameworks and regulatory compliance requirements.Experience supporting AI, machine learning, and advanced analytics initiatives.Prior experience serving as a technical lead or mentoring other data engineers.---Education & CertificationsBachelor's degree in Computer Science, Data Engineering, Software Engineering, or a related field (or equivalent professional experience).Preferred Microsoft CertificationsDP-700: Microsoft Fabric Data Engineer AssociateDP-600: Fabric Analytics Engineer AssociateAZ-305: Azure Solutions Architect ExpertAZ-204: Azure Developer AssociateDP-203 (or equivalent Azure Data Engineering certification)---Why Join Us?· Lead the modernization of a rapidly growing enterprise data platform.· Shape the future of analytics, reporting, and AI across three industry-leading construction organizations.· Work with modern Microsoft technologies including Fabric, Azure, Power BI, and AI solutions.· Collaborate with business leaders who value data-driven decision making.· Be part of an organization consistently recognized as one of Pittsburgh's Best Places to Work.Work Arrangement: Hybrid (Pittsburgh)Individuals with Disabilities: PJ Dick-Trumbull-The Lindy Group wants all interested and qualified candidates to be able to use the career site to review and apply for employment opportunities. If you have a disability and need an accommodation to access this site, please contact us for assistance at 412.807.2000 or email us at careers@pjdick.com.PJ Dick-Trumbull-The Lindy Group strives to create a diverse, safe, welcoming, and inclusive work environment in which all teams can excel.We are an Equal Opportunity and VEVRAA Federal Contracting Employer and welcome all applications from a wide range of candidates, including covered veterans, minorities, females, and people with disabilities. Our policy is clear: We do not discriminate based on any characteristic protected by law.To view our EEO policy, click here; to view our Section 503 and VEVRAA Affirmative Action Policy, click here.

Numbers & Facts

LocationPittsburgh, PA
Job TypeFull-time

Skills

  • Analysis Skillsunmatched
  • Application Programming Interface (API)unmatched
  • Artificial Intelligence (AI)unmatched
  • Best Practicesunmatched
  • Business Intelligenceunmatched
  • Business Modelunmatched
  • Business Supportunmatched
  • Cloud Computingunmatched
  • Communication Skillsunmatched
  • Computer Scienceunmatched
  • Constructionunmatched
  • Construction Engineeringunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Cost Controlunmatched
  • Data Analysisunmatched
  • Data Managementunmatched
  • Data Modelingunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Setsunmatched
  • Data Structuresunmatched
  • Data Warehousingunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • DevOpsunmatched
  • Dimensional Modelingunmatched
  • Documentationunmatched
  • ERP (Enterprise Resource Planning)unmatched
  • Ecosystemsunmatched
  • Engineeringunmatched
  • Financial Operationsunmatched
  • Gitunmatched
  • Identify Issuesunmatched
  • Information/Data Security (InfoSec)unmatched
  • Leadershipunmatched
  • Machine Learningunmatched
  • Manufacturingunmatched
  • Master Data Management (MDM)unmatched
  • Mentoringunmatched
  • Metadataunmatched
  • Microsoft Product Familyunmatched
  • Microsoft Windows Azureunmatched
  • Multitaskingunmatched
  • NoSQLunmatched
  • Operational Supportunmatched
  • Operations Processesunmatched
  • Performance Tuning/Optimizationunmatched
  • Power BIunmatched
  • Presentation/Verbal Skillsunmatched
  • Problem Solving Skillsunmatched
  • Process Modelingunmatched
  • Production Systemsunmatched
  • Professional Servicesunmatched
  • Project/Program Managementunmatched
  • Python Programming/Scripting Languageunmatched
  • REST (Representational State Transfer)unmatched
  • Regulatory Complianceunmatched
  • Regulatory Requirementsunmatched
  • Requirements Managementunmatched
  • Reverse Engineeringunmatched
  • Root Cause Analysisunmatched
  • SQL (Structured Query Language)unmatched
  • SQL Databasesunmatched
  • Scalable System Developmentunmatched
  • Software Developmentunmatched
  • Software Engineeringunmatched
  • Software as a Service (SaaS)unmatched
  • Source Code/Configuration Management (SCM)unmatched
  • Structured Dataunmatched
  • Technical Leadershipunmatched
  • Unstructured Dataunmatched
  • Writing Skillsunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder