Position Summary
Curant Health is seeking a Data Engineer II to design, develop, and support scalable data solutions across the organization. This role will focus on building and optimizing ETL/ELT pipelines, data integrations, and data processing frameworks that support Curant Health’s operational, clinical, and business intelligence needs.
The ideal candidate has strong experience with SQL, C#, SSIS, Azure data technologies, and modern data engineering practices. This individual will work closely with technical and business partners to translate requirements into secure, reliable, and scalable data solutions.
The Data Engineer II will also leverage Artificial Intelligence (AI), Generative AI, and AI-assisted development tools to improve development efficiency, automate data engineering workflows, and enhance existing data processes.
Duties and Responsibilities
Core duties and responsibilities include the following. Other duties may be assigned based on business needs.
Data Engineering and ETL Development
- Design, develop, test, and maintain secure, reliable, and scalable ETL/ELT pipelines based on business requirements and user stories.
- Develop and enhance data processing frameworks using SQL, C#, SSIS, and Azure technologies.
- Design and maintain integrations between internal systems, external data sources, applications, and reporting environments.
- Write and optimize complex SQL queries, stored procedures, and data transformation logic.
- Design and support relational databases, data warehouses, and dimensional data models.
- Monitor data pipelines and troubleshoot processing failures, data discrepancies, and performance issues.
- Implement appropriate data validation and quality controls throughout data pipelines.
Azure and Cloud Data Solutions
- Design, implement, and support data solutions using technologies such as Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
- Develop and maintain scalable cloud-based data pipelines and processing environments.
- Utilize Azure Key Vault and other security tools to support secure data access and credential management.
- Support Snowflake, Spark, and other modern data processing technologies as applicable.
- Identify opportunities to improve infrastructure, scalability, reliability, and data delivery.
AI and Automation
- Leverage AI, Generative AI, and AI-assisted development tools to accelerate data engineering and development workflows.
- Apply AI technologies to support the development, automation, testing, documentation, and optimization of ETL/ELT pipelines.
- Identify opportunities to automate repetitive data engineering and operational processes.
- Evaluate emerging AI and data technologies for potential application within Curant Health’s data environment.
- Ensure AI-assisted solutions align with organizational security, privacy, data governance, and quality standards.
Development, Testing, and Deployment
- Develop, test, debug, and maintain code to ensure solutions meet technical and business requirements.
- Design and support Azure DevOps CI/CD pipelines for automated deployment and release management.
- Participate in code reviews, testing, troubleshooting, and production deployment activities.
- Estimate and plan development work, track progress, and deliver assigned projects within established timelines.
- Maintain technical documentation for data pipelines, integrations, processes, configurations, and troubleshooting procedures.
Project and Cross-Functional Collaboration
- Take ownership of assigned projects and drive work from requirements gathering through implementation and ongoing support.
- Partner with business stakeholders, analysts, developers, and other IT team members to understand requirements and develop appropriate solutions.
- Translate business requirements into technical specifications and scalable data solutions.
- Identify and implement internal process improvements related to data delivery, automation, performance, and infrastructure.
- Communicate project status, technical challenges, risks, and recommended solutions clearly to appropriate stakeholders.
SharePoint Support
- Support the administration, maintenance, and development of SharePoint and SharePoint Online environments as needed.
- Assist with the creation and management of SharePoint sites, permissions, integrations, and related solutions.
- Troubleshoot SharePoint-related issues and coordinate resolutions as appropriate.