A leading consulting firm is seeking a Sr. Test Data Engineer for a 6+ month contract to hire role. This is a remote role, but the client is located in Chicago, IL.
Duties:
* Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions.
* Perform end-to-end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems.
* Develop and execute complex SQL queries for backend and data validation testing.
* Test large-scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF).
* Perform functional, integration, regression, system, and data quality testing across data pipelines and applications.
* Validate batch processing, job scheduling, dependencies, and workflow execution using Control-M and Unix/Linux environments.
* Identify, document, track, and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution.
* Develop and maintain reusable test scripts and automation solutions where applicable.
* Participate in Agile/Scrum activities including sprint planning, refinement, daily stand-ups, reviews, and retrospectives.
* Support test execution, release validation, production readiness, and post-deployment verification while ensuring established quality standards are met.
Requirements
* 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing.
* Strong hands-on SQL skills, including writing complex queries for source-to-target validation, reconciliation, and data quality testing.
* Experience testing large-scale data platforms and ETL/ELT pipelines.
* Hands-on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).
* Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive.
* Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control-M.
* Strong understanding of data quality concepts, data transformations, data mappings, and source-to-target validation.
* Experience with defect management and test management processes within Agile/Scrum delivery environments.
* Strong analytical, troubleshooting, communication, and collaboration skills.
U.S. Medicare Experience preferred
ETL Testing & Data Validation 6+ years
SQL & Data Quality Testing 6+ years
Databricks / Apache Spark / PySpark 5+ years
Python & Test Automation 5+ years
Azure Data Factory (ADF) 5+ years