Position: AI QA Engineer Location: Rosemead, CA Duration: Contract
Ensures AI products behave accurately, safely, fairly, and reliably across real world scenarios. Partners with Product, Engineering, and SMEs to validate model behavior, data quality, and trust risks across the AI lifecycle.
Key Responsibilities:
Test AI outputs for accuracy, consistency, edge cases, and failure modes
Validate training and inference data quality; identify bias and data leakage risks
Define and execute model evaluation and regression tests
Reuse and expand the Golden Dataset for regression testing across builds, prompt/model changes, and releases.
Test AI behavior within end to end user workflows and integrations
Support Responsible AI testing (fairness, explainability, compliance)
Monitor model performance post release (drift, feedback, regressions)
Test automation coverage
Communicate risks and test findings clearly to stakeholders
Track & report quality metrics such as accuracy, precision (and recall where applicable), clearly highlighting missing, incorrect, or hallucinated content.
Required Skills
QA/test planning, exploratory testing, and UAT experience
AI/ML fundamentals and evaluation metrics literacy
Data analysis and model behavior reasoning
Ability to test GenAI prompts and outputs (preferred)
Strong domain knowledge and user centric mindset
Clear documentation and communication skills
Qualifications:
3–7+ years in QA, testing, or quality roles
Experience with AI/data driven products preferred
ISTQB, AI/Data, or Responsible AI training is a plus
Numbers & Facts
Location
Rosemead, CA
Skills
Acceptance Testingunmatched
Artificial Intelligence (AI)unmatched
Communication Skillsunmatched
Computer Securityunmatched
Data Analysisunmatched
Data Modelingunmatched
Data Qualityunmatched
Data Setsunmatched
Documentationunmatched
Fundamental Analysisunmatched
ISTQB Foundationunmatched
Literacyunmatched
Metricsunmatched
Model Validationunmatched
Performance Analysisunmatched
Performance Modelingunmatched
Product Engineeringunmatched
Quality Assuranceunmatched
Regression Testingunmatched
Test Automationunmatched
Testingunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.