Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Engineering & Software Domain Expert Type:Contract Compensation:$65–$105/hour Location:Hybrid, Bay Area, California Commitment:40 hours/week
Role Responsibilities
Evaluate the quality of engineering knowledge work tasks and AI model outputs. Identify missing behaviors, thin reasoning, and code errors.
Develop high-quality instruction specs and golden solutions for engineering problems. Define new tasks reflecting practical engineering work.
Design challenging engineering tasks and evaluation sets. Build domain-specific skills and tools with the research team.
Collaborate with client researchers and specialists to maintain consistent standards. Translate tacit engineering judgment into explicit criteria.
Work independently and asynchronously to meet deadlines while improving AI model performance.
Qualifications
Must-Have
Bachelor's degree or higher in computer science, software engineering, or a related field. MS or PhD preferred.
4+ years of professional engineering practice, building and shipping production software or systems.
Specialization in areas like distributed systems, security, embedded systems, or machine learning.
Progression to a senior level, such as Senior, Staff, Principal, or Engineering Lead.
Hands-on use of large language models in professional work.
Commitment to 40 hours/week for an initial 6-month engagement.
Reside in the Bay Area, California, and work on-site as required.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Numbers & Facts
Location
San Francisco, California
Salary
$65–$105 Per Hour
Skills
Artificial Intelligence (AI)unmatched
Benchmarkingunmatched
Computer Scienceunmatched
Customer/Client Researchunmatched
Distributed Computingunmatched
Embedded Systemsunmatched
Machine Learningunmatched
Modeling Languagesunmatched
Performance Managementunmatched
Performance Modelingunmatched
Production Systemsunmatched
Quality Engineeringunmatched
Research Laboratoryunmatched
Software Engineeringunmatched
Technical/Engineering Designunmatched
Time Managementunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.