Sr. Data Engineer

Position Overview:

This senior engineer will build and maintain data integrations that connect healthcare, life sciences, and academic research organizations across Indiana. The work centers on Databricks and on bringing data from separate organizations into a shared, governed environment.

Responsibilities:

Leads the design, development, and optimization of enterprise data solutions using modern cloud technologies, including Databricks and Azure, to support analytics, artificial intelligence, operational reporting, and research initiatives. 

Designs and maintains scalable data platforms, integration pipelines, and data models, including OMOP-based data structures, while ensuring data quality, security, governance, and accessibility. 

Partners with analytics teams, researchers, clinicians, and business stakeholders to deliver trusted, research-ready data assets that enable innovation and informed decision-making.

Qualifications:

• Bachelor's Degree or equivalent years of experience is required.
• Requires a minimum of 4-6 years of relevant experience.
• Requires advanced experience developing data pipelines and ETL/ELT processes using Databricks and modern data engineering technologies.
• Requires experience supporting healthcare analytics, OMOP, research, or clinical data environments.
• Requires a demonstrated ability to resolve complex technical issues
• Experience with performance optimization and application scalability is preferred.
• Experience implementing CI/CD pipelines and DevOps practices is preferred. 
• Strong understanding of data modeling, information management principles, SDLC, and enterprise architecture.
• Excellent analytical, problem-solving, communication, and collaboration skills.
• Preferred: Databricks Certified Data Engineer Associate or equivalent certification