Kafka Tester

Judge Group

Pittsburgh, PA

JOB DETAILS
SALARY
$100,000–$120,000 Per Year
LOCATION
Pittsburgh, PA
POSTED
30+ days ago
Location: Pittsburgh, PA
Salary: $100,000.00 USD Annually - $120,000.00 USD Annually
Description:

Must Have Technical/Functional Skills:

  • Apache Kafka: Deep understanding of Kafka's architecture, components, and functionality. 
  • SQL: Experience with SQL for data validation and debugging. 
  • ETL: Experience with ETL processes and data warehousing concepts. 
  • Test Automation: Experience in developing and maintaining automated tests for data pipelines. 
  • Data Analysis: Ability to analyze data, identify issues, and propose solutions. 
  • Communication: Strong communication and collaboration skills are essential for working with development teams. 


Roles & Responsibilities:

  • Data Pipeline Testing: Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data. 
  • Data Validation: Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.
  • Kafka Expertise: Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka's architecture and concepts. 
  • Scripting and Automation: Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts. 
  • Issue Resolution: Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions. 
  • Performance Testing: Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput. 
  • Agile/Scrum: Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle.
  • Data Warehousing: Familiarity with data warehousing concepts and cloud data platforms is often a plus. 

    By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.


    Contact: tmangal@judge.com
    This job and many more are available through The Judge Group. Find us on the web at www.judge.com

    About the Company

    J

    Judge Group

    The Judge Group Inc., is a leading professional services firm specializing in talent, technology, and learning solutions. We consult, staff, train, and solve. Through our work we make people and organizations better. Our services are successfully delivered through a network of more than 30 offices across the United States, Canada, and India.

    The Judge Group is proud to partner with the best and brightest companies in business today, including over 60 of the Fortune 100. We serve organizations in financial services, healthcare, life sciences, insurance, government (including aerospace and defense), manufacturing, and technology and telecommunications. If you would like to learn more about The Judge Group visit www.judge.com or call toll free (800) 360-4474.

    COMPANY SIZE
    5,000 to 9,999 employees
    INDUSTRY
    Computer/IT Services
    FOUNDED
    1970
    WEBSITE
    https://www.judge.com