• Irving, TX
  • $100,000–$125,000 Per Year
8 days ago

Job Description

Role: Engineer

Required Skills: Python

Qualification: BACHELOR OF COMPUTER SCIENCE

Experience: 6 - 8 Years

Function: TECHNOLOGY

Apply By: 2026-12-18

Must Have Technical/Functional Skills

Associates with 7-10 years' experience in data/ETL testing with hands-on PySpark and exposure to big data tools.

Ability to perform below responsibilities:

  1. Design scalable PySpark-based test architectures for ETL/data pipelines, including modular frameworks for batch processing.

  2. Architect end-to-end data validation systems in Hadoop environment for lineage, schema evolution

  3. Lead system design for Hadoop/Hive test environments, including YARN resource management, dynamic partitioning.

  4. Exposure to Zephyr-Jira-ServiceNow integrated test management systems with experience on API-driven automation.

  5. Design CI/CD test pipelines for PySpark/Hadoop jobs, incorporating artifact management, parallel execution, and blue-green deployments.

  6. Create data quality system designs using PySpark integrated with Hive metadata services.

  7. Design testing platforms, test data generators

  8. Mentor juniors on PySpark testing basics, contribute to testing strategy discussions

Salary Range: $100,000 to $125,000 per year

Numbers & Facts

LocationIrving, TX
Salary$100,000–$125,000 Per Year

Skills

  • Apache Hadoopunmatched
  • Apache Hiveunmatched
  • Apiary/Beekeepingunmatched
  • Application Programming Interface (API)unmatched
  • Atlassian JIRAunmatched
  • Automationunmatched
  • Big Dataunmatched
  • Computer Scienceunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Data Managementunmatched
  • Data Qualityunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • Metadataunmatched
  • Resource Managementunmatched
  • ServiceNowunmatched
  • System Integration (SI)unmatched
  • Test Dataunmatched
  • Test Designunmatched
  • Testingunmatched

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Resume Builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Resume Builder