About Turing:
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview:
We are seeking a highly qualified Video Games Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within game development, esports, platforms, game design, publishers, communities.
Key Responsibilities:
- Create advanced prompts covering game development, esports, platforms, game design, publishers, communities.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback with reliable references.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and documentation.
Minimum Qualifications:
- Master's degree or higher in any field; degrees in Game Design, Game Development, Computer Science, Interactive Media, Digital Arts, Software Engineering, Animation, or other gaming-related disciplines are preferred.
- Strong knowledge of the video games industry, including game development, game design principles, gaming platforms, genres, publishers, studios, esports, gaming communities, and current industry trends.
- 3+ years of relevant professional experience, preferably in game development, game design, QA, esports, gaming journalism, content creation, research, community management, or a related field.
- Excellent written English, research, and analytical skills.
- Strong attention to detail and ability to evaluate gaming-related information accurately, identify factual inconsistencies, and assess reasoning across a wide range of video game topics.
Preferred Qualifications:
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to work independently and provide objective, evidence-backed reviews.
Offer Details:
- Commitments Required: 40 hours per week with at least 4 hours PST overlap
- Employment type : Contractor assignment (no medical/paid leave)
- Duration of contract : 8 weeks.
- Location Must be currently based in the United States.
Application Process:
- Complete the assessment shared with you.
- Our team will evaluate your submission.
- Selected candidates will be contacted regarding the next steps.