Azure Data Engineer Senior

AmeriHealth Caritas

Newtown Square, PA

Apply

JOB DETAILS

SKILLS

Administrative Skills, Agile Programming Methodologies, Analysis Skills, Application Programming Interface (API), Artificial Intelligence (AI), Authentication, Automation, Autoscaling, Backlog Prioritization, Behavioral Health, Best Practices, Biotech and Pharmaceutical, Caching, Centers for Disease Control and Prevention (CDC), Cloud Computing, Coaching, Code Reviews, Coding Standards, Communication Skills, Compensation and Benefits, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Cost Control, Data Analysis, Data Lake, Data Management, Data Processing, Data Quality, Data Science, Data Storage, Data Warehousing, Database Extract Transform and Load (ETL), DevOps, Dimensional Modeling, Diversity, Documentation, Error Handling, Establish Priorities, Git, Healthcare, Hubs, Identify Issues, Information Technology & Information Systems, Kanban, Leadership, Managed Care, Mentoring, Metadata, Microsoft Windows Azure, Pagination, Performance Tuning/Optimization, Pharmacy, Presentation/Verbal Skills, Problem Solving Skills, Process Improvement, Product Management, Quality Engineering, Quality Management, REST (Representational State Transfer), Requirements Management, SQL (Structured Query Language), Scrum Project Management and Software Development, Service Level Agreement (SLA), Snowflake Schema, Software Engineering, Team Player, Technical Leadership, Technical Presentation, Technical/Engineering Design, Test Automation, Traffic Shaping

LOCATION

Newtown Square, PA

POSTED

Today

THIS IS A HYBRID, OFFICE BASED POSITION WORKING AT OUR ELLIS PRESERVE OFFICE LOCATED IN NEWTOWN SQUARE, PA.

WE WILL NOT CONSIDER REMOTE CANDIDATES!

Role Overview

The Senior Azure Data Engineer designs, builds, and optimizes large scale cloud data solutions on Microsoft Azure. The role requires deep hands on expertise with modern ingestion frameworks to ingest diverse data sources, on distributed compute, real-time streaming, and dimensional modeling, combined with strong Agile delivery practices and leadership in guiding junior developers. Experience with GenAI technologies is increasingly important as the organization evolves toward intelligent data products.

Work Arrangement

+ This a HYBRID office based position working in our Ellis Preserve office located in Newtown Square, PA. Core office days are Tuesday, Wednesday, and Thursday.

Responsibilities

+ Architecture & Implementation: Design and implement scalable engineering solutions using Azure Data Factory, Azure Databricks, Azure Event Hubs, Kafka, HVR, Snowflake, and Azure Data Lake Storage

+ Pipeline Development: Build robust ETL/ELT pipelines for batch and streaming workloads using PySpark and SQL, ensuring fault tolerance, schema evolution handling, and idempotency

+ API Ingestion: Implement reliable API data ingestion patterns including authentication, pagination, rate limit handling, retries, and schema mapping

+ Real time Integration: Design and operate event driven ingestion and processing using Event Hubs and Kafka, and integrate CDC solutions using HVR

+ Performance Optimization : Tune Databricks jobs and clusters (cluster sizing, autoscaling, caching, partitioning, shuffle optimization, Delta Lake optimizations) to meet SLAs and cost targets

+ DevOps & CI/CD: Use Azure DevOps for backlog management, Git workflows, YAML pipelines, automated testing, and repeatable deployments across environments

+ Code Quality & Mentorship: Perform code reviews, enforce coding standards and best practices, and mentor junior developers to raise team capability

+ Gen AI Enablement: Apply Gen AI knowledge to accelerate development (code generation, data documentation, prompt engineering for data tasks) and to integrate AI driven data products where applicable

+ Stakeholder Collaboration: Work with product owners, data scientists, analysts, and architects to translate business requirements into prioritized user stories and deliverables in Agile sprints

+ Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

+ Identify and tackle issues concerning data management to improve data quality

+ Understand and implement best practices in management of data, including master data, reference data, metadata, data quality and lineage

Education and Experience

+ Master’s degree in computer science, Information Systems, Software Engineering

+ Technical: Hands on experience with Azure Data Factory (6+ years), Azure Databricks (6+ years), HVR (3+ years), Kafka (5+ years), Event Hubs (3+ years), Snowflake (5+ years), Azure Data Lake Storage, PySpark (10+ years), and SQL (12+ years)

+ Modeling: Strong expertise in dimensional modeling, SCD implementation, and data warehouse best practices

+ Agile Delivery: Proven experience delivering data projects in Agile (Scrum or Kanban) teams

+ DevOps: Practical experience with Azure DevOps for CI/CD, branching strategies, and pipeline automation

+ Performance: Demonstrated ability to profile and optimize Databricks jobs and large scale data processing workloads

+ Integration: Experience ingesting data from REST APIs and external systems, handling schema drift and error handling

+ Leadership: Track record of conducting code reviews, providing technical guidance, and mentoring junior engineers

+ Communication: Clear communicator able to present technical tradeoffs to technical and non technical stakeholders

+ Experience with Collibra Data governance features

+ Familiarity with MLOps patterns and integrating data platforms with ML pipelines

+ Azure certifications such as DP 700, AZ 400, or Databricks Data Engineer certification

+ Prior work with cost optimization and observability tools for cloud data platforms

+ Practical experience applying Gen AI (LLMs, embeddings, retrieval augmentation) to data engineering workflows]

Other Skills

+ Problem solving : Analytical approach to diagnose performance and data quality issues

+ Collaboration: Strong team player who partners effectively across product, analytics, and platform teams

+ Mentorship: Patient, constructive coach who elevates code quality and engineering practices

+ Adaptability: Comfortable with shifting priorities and iterative delivery in fast moving environments

Our Comprehensive Benefits Package

Flexible work solutions including remote options, hybrid work schedules, Competitive pay, Paid time off including holidays and volunteer events, Health insurance coverage for you and your dependents on Day 1, 401(k) Tuition reimbursement and more.

Your career starts now. We're looking for the next generation of health care leaders.

At AmeriHealth Caritas, we're passionate about helping people get care, stay well and build healthy communities. As one of the nation's leaders in health care solutions, we offer our associates the opportunity to impact the lives of millions of people through our national footprint of products, services and award-winning programs. AmeriHealth Caritas is seeking talented, passionate individuals to join our team. Together we can build healthier communities. If you want to make a difference, we'd like to hear from you.

Headquartered in Newtown Square, PA, AmeriHealth Caritas is a mission-driven organization with more than 30 years of experience. We deliver comprehensive, outcomes-driven care to those who need it most. We offer integrated managed care products, pharmaceutical benefit management and specialty pharmacy services, behavioral health services, and other administrative services.

Discover more about us at www.amerihealthcaritas.com.
As a company, we support internal diversity through:

Recruiting. We are an equal opportunity employer. We do not discriminate on the basis of age, race, ethnicity, gender, religion, sexual orientation, or disability. Our inclusive, equitable approach to recruiting and hiring reinforces our commitment to DEI.

About the Company

AmeriHealth Caritas

Leaders in health care solutions for those most in need

AmeriHealth Caritas is the nation's leader in providing comprehensive health care solutions for those in most need and the chronically ill. We impact the lives of more than 5.7 million members nationwide. With more than 30 years of experience managing care for individuals and families in publicly-funded programs, we have become known for developing innovative solutions that help improve health outcomes while reducing costs.

Our mission, our goal

Our mission is to help people get care, stay well and build healthy communities. Our goal is to provide responsible managed care solutions, including Medicaid, Medicare, and CHIP - plus behavioral health, pharmacy benefits management and third-party management and administrative services.

COMPANY SIZE

5,000 to 9,999 employees

INDUSTRY

Healthcare Services

FOUNDED

1985

WEBSITE

http://www.amerihealthcaritas.com

Resume Resources

Free Resume Templates Free Resume Builder