E-commerce domain exp. is mandatory. Job Description: The AI/ML Test Lead will own endtoend quality assurance for AIdriven solutions across Ulta's Enterprise AI.This role is responsible for defining and executing an Enterprise AI testing strategy, ensuring functional correctness, data accuracy, AI output quality, robustness, performance, and Responsible AI compliance. The role blends handson testing leadership, AI/MLspecific validation, and onsite stakeholder collaboration, working closely with Product Owners, AI Engineering Leads and Data teams. Required Skills & Experience- Core QA & Testing Experience
10+ years of experience in QA / Testing roles, with leadership responsibility
Strong experience defining test strategy, test plans, and execution ownership
Experience testing dataheavy and analyticsdriven systems
AI / ML / Data Testing Skills
Handson experience testing AI/ML or LLMbased solutions
Strong understanding of:
Data validation and KPI testing
AI output correctness and consistency
Promptbased and agentbased systems
Familiarity with AI evaluation metrics (accuracy, error rate, hallucination rate, relevance)
Numbers & Facts
Location
Bolingbrook, IL
Industry
Other/Not Classified
Company Size
100 to 499 employees
Skills
Artificial Intelligence (AI)unmatched
Data Qualityunmatched
Leadershipunmatched
Metricsunmatched
Performance Metricsunmatched
Quality Assuranceunmatched
Team Lead/Managerunmatched
Test Plan/Scheduleunmatched
Test Strategyunmatched
Testingunmatched
Validation Testingunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.