You will identify modernization opportunities, elevate the roadmap, and execute technical strategy of a durable evaluation system for GenAI and ML workloads at Pinterest, partnering across engineering, research, product, and safety to improve quality, launch decisions, and trust in AI-powered experiences. 3+ years of deep, hands-on experience designing and operating evaluation systems for GenAI and complex ML systems, including benchmark design, golden datasets, automated metrics, human evaluation, model-based grading, and failure analysis.