Medical Evaluation Specialist

IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.

This is a fully remote position, open to candidates based in United States.

Pay: $40–$90/hr

Role Title: Medical Evaluation Specialist (students, residents, physicians)

Role Type: Contractor

Location: Remote

We are engaging Medical Evaluation Specialists (students, residents, physicians) to contribute advanced clinical insights to a cutting-edge customer project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. As a contributor, you will design and verify high-quality, challenging medical questions and answers that probe the depth and reliability of today's frontier AI, focusing on the places where nuanced medical reasoning makes the difference.

Scope of Work

1. Craft original, high-difficulty medical question-and-answer pairs covering diagnosis, mechanisms, pharmacology, guidelines, and clinical judgment.
2. Source and verify answers using primary literature, clinical guidelines, and authoritative references; thoroughly document rationale and citations.
3. Develop questions requiring synthesis and genuine clinical reasoning rather than simple fact recall.
4. Evaluate AI model responses to your questions, refine those that are too straightforward, and enhance complexity while ensuring clinical accuracy.
5. Ensure all questions and answers are written with clarity, precision, and defensibility — avoiding ambiguity.
6. Incorporate reviewer feedback and align deliverables with evolving project guidelines and standards.

Preferred Qualifications

1. Current medical training or clinical practice as a student, resident, or physician, or equivalent biomedical expertise.
2. Demonstrated ability to locate, interpret, and synthesize information from primary literature and clinical guidelines.
3. Exceptional attention to detail and proficiency in written English (native fluency not required).
4. Talent for creating engaging, well-structured, and clinically nuanced questions.
5. Self-motivated and reliable in managing independent remote contributions.
6. Experience with medical question writing, peer review, or evaluative projects is an advantage.
7. Familiarity with AI/ML systems or model evaluation is a plus but not essential.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

How to apply

Apply here with your profile. We will then email you a link to complete your application on the hiring platform — your application is only considered once that final step is done.