Develop and execute strategies for Meta's product teams to evaluate LLMs at scale across content work Build, lead, and mentor a team of content engineers, fostering a culture of creativity, excellence, and professional growth Drive sprints for LLM evaluations and automated evaluation tooling while devising and implementing systems to increase evaluation capacity Understand technical product needs and translate those into actionable direction for content-focused cross-functional teams Understand Meta's strategic and competitive position and deliver content strategies and product solutions that are aligned with our mission and aligned with our mission and competitive in the industry Define emergent opportunities and drive impact via execution in highly ambiguous areas Lead cross-functionally with engineering, data science, and product teams to align AI behaviors and content experiences with real-world user expectations10+ years of experience improving content quality and relevance on content platforms, including work with video creators, ranking systems, content strategy 3+ years of professional experience in hiring, managing and developing individual contributors 1+ year working with GenAI products, prompt engineering, annotation, and/or content evaluation and analysis Experience driving cross-functional projects autonomously to build products, respond to urgent needs, preempt issues and address concerns in a collaborative and timely fashion Familiarity with AI industry trends demonstrated through past work applying them to content strategy and the ability to translate them into actionable content strategy Experience applying critical thinking to lead data-driven analyses that inform product or content decisions, and communicating findings to executive leadership Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews) 2+ years of experience working closely with ranking teams BA or BS in Computer Science, Data Science, Linguistics, or related field Experience with data visualization tools such as Tableau Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements) 4+ years of work experience in product management, data analytics, or content operations in a large-scale content platformMeta builds technologies that help people connect, find communities, and grow businesses. We're looking for an experienced manager to join our team and help define how Meta evaluates and improves AI content experiences and manage a team of team members across a variety of projects.