Sr. Data Engineer (PySpark, Azure Data Factory)

ePATHUSA
  • Houston, Texas
    30+ days ago

    Job Description

    As an Data Engineer at Calpine Inc., you will contribute to the BI development to optimize energy operations, enhance forecasting, and improve operational efficiency.  This role is ideal for professionals with 10+ years of experience who are passionate comprehensive data and BI solutions development and solving real-world energy sector challenges using PySpark and Azure Data Factory.

    Job Responsibilities

    • Engage with business users to gather requirements and translate them into comprehensive data and BI solutions.
    • Design and implement scalable data pipelines using PySparkand Azure Data Factory, integrating with Azure Data LakeSynapse AnalyticsDataBricks, and Microsoft Fabric.
    • Develop and optimize data models and visualizations using Power BI, ensuring performance and usability across business units.
    • Lead modernization efforts by migrating legacy BI systems to cloud-based platforms.
    • Collaborate with cross-functional teams to ensure alignment with architectural standards and business objectives.
    • Oversee system testing, user acceptance testing (UAT), and production deployments.
    • Maintain and enhance existing BI solutions, ensuring reliability and scalability.
    • Document data flows, transformation logic, and architectural decisions.
    • Communicate effectively with stakeholders regarding upcoming changes and coordinate change management activities.


    Requirements

    Job Requirements

    • Minimum 8-10 years of experience in data engineering and BI development.
    • Proven expertise in PySpark for data transformation and pipeline development.
    • Extensive experience with Azure Data Services, including Data FactoryData LakeSynapse,Microsoft Fabricand DataBricks.
    • Strong proficiency in Power BI dashboard development and data modeling.
    • Solid understanding of cloud architecture, data governance, and performance optimization.
    • Advanced SQL skills with a focus on query performance and scalability.
    • Experience with dimensional modeling (Star and Snowflake schemas).
    • Excellent communication and collaboration skills in cross-functional environments.
    • Ability to manage multiple priorities in a dynamic and fast-paced setting.
    • Familiarity with SSISSSRS, and SSAS(tabular and multi-dimensional models).
    • Experience with DAX and MDX query languages.
    • Exposure to Power AppsData Flows
    • Knowledge of machine learning (ML)and artificial intelligence (AI) concepts and their application in data analytics.
    • Have worked with Azure ML Services, and understand OpenAI LLM Model.
    • Experience implementing role-based and row-level security in BI platforms.


    Benefits

    Benefits include:  
    • Medical, vision and dental
    • Prescription drug coverage
    • Calpine’s Retirement Savings Plan (401(K)) matching
    • Paid time off and paid parental leave
    • Comprehensive health programs, including our Wellness Program, telemedicine, Employee Assistance Program, Health Care and Dependents Care Flexible Spending Accounts (FSAs) and more
    • Life insurance
    • Education reimbursement program
    • Adoption assistance
    • Scholarship and vocational grant programs
    • Training and education opportunities
    • Bonus eligible


    Numbers & Facts

    LocationHouston, Texas
    Websitehttps://www.epathusa.net/careers/

    Skills

    • Acceptance Testingunmatched
    • Architectural Servicesunmatched
    • Artificial Intelligence (AI)unmatched
    • Business Intelligenceunmatched
    • Change Managementunmatched
    • Cloud Architectureunmatched
    • Cloud Computingunmatched
    • Communication Skillsunmatched
    • Cross-Functionalunmatched
    • Customer/Client Researchunmatched
    • Data Analysisunmatched
    • Data Lakeunmatched
    • Data Managementunmatched
    • Data Modelingunmatched
    • Data Visualizationunmatched
    • Database Programming Languagesunmatched
    • Dimensional Modelingunmatched
    • Forecastingunmatched
    • MDX (MultiDimensional eXpression Language)unmatched
    • Machine Learningunmatched
    • Microsoft Product Familyunmatched
    • Microsoft Windows Azureunmatched
    • Multitaskingunmatched
    • Operational Improvementunmatched
    • Operational Strategyunmatched
    • Performance Tuning/Optimizationunmatched
    • Power BIunmatched
    • Reimbursementunmatched
    • Reporting Dashboardsunmatched
    • Requirements Managementunmatched
    • SQL (Structured Query Language)unmatched
    • SQL Server Analysis Services (SSAS)unmatched
    • SQL Server Integration Services (SSIS)unmatched
    • SQL Server Reporting Services (SSRS)unmatched
    • Scholarshipunmatched
    • Security Infrastructureunmatched
    • Snowflake Schemaunmatched
    • Star Schemaunmatched
    • System Migrationunmatched
    • System Testunmatched
    • Team Playerunmatched
    • Usability Engineeringunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder