Senior AI Trainer – Remote

RemoteJobsOne
  • New York, New York
  • Remote
  • $14–$36 Per Hour
10 days ago

Job Description

IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.

This is a fully remote position, open to candidates based in 55 countries, including United States, United Kingdom, Canada, Germany, India, France, Netherlands, Singapore.

Pay: $14–$36/hr

Role Title: Senior AI Trainer

Role Type: Contractor, Remote

Location: Northern America and Germany.

We are engaging Senior AI Trainers to collaborate on a customer-driven project enhancing AI system quality through expert-level model training and evaluation. In this role, you'll apply your generalist expertise and hands-on experience with AI products to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

Key Responsibilities:

  1. Evaluate the performance of AI chat and search tools under standardized, repeatable conditions.
  2. Apply detailed grading guidelines to accurately evaluate, rank, and annotate model responses, providing structured feedback that improves model performance.
  3. Write, refine, and stress-test prompts that probe model capabilities, ensuring coverage of diverse scenarios, edge cases, and user intents.
  4. Verify consistency and accuracy across evaluations, correcting discrepancies between ratings and the underlying rubric or guidelines.
  5. Utilize AI training tools and platforms to record findings and submit evaluation datasets in alignment with project standards and milestones.
  6. Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
  7. Participate in ongoing quality reviews, incorporating feedback to maintain rigorous training and annotation standards.

Required Skills and Qualifications:

  1. Exceptional attention to detail and accuracy in reviewing and evaluating AI-generated content.
  2. Strong written and verbal communication skills for effective collaboration, reporting, and timely updates on progress and challenges.
  3. Demonstrated time management and self-organization abilities for independent, remote project participation.
  4. Analytical and problem-solving mindset, with a proactive approach to resolving evaluation challenges.

Preferred Qualifications:

  1. Proven experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects.
  2. Familiarity with AI products and tools, including prompt engineering and understanding of model behaviors and limitations.
  3. Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety.
  4. Background in AI training, machine learning data preparation, or LLM-focused projects (strongly preferred).

How to apply

Apply here with your profile. We will then email you a link to complete your application on the hiring platform — your application is only considered once that final step is done.

Numbers & Facts

LocationNew York, New York (
Remote
)
Salary$14–$36 Per Hour

Skills

  • Analysis Skillsunmatched
  • Artificial Intelligence (AI)unmatched
  • Communication Skillsunmatched
  • Data Analysisunmatched
  • Data Setsunmatched
  • Detail Orientedunmatched
  • Machine Learningunmatched
  • Organizational Skillsunmatched
  • Performance Managementunmatched
  • Performance Modelingunmatched
  • Presentation/Verbal Skillsunmatched
  • Problem Solving Skillsunmatched
  • Project Evaluationunmatched
  • Stress Testingunmatched
  • Team Playerunmatched
  • Time Managementunmatched
  • Training Toolsunmatched
  • Training/Teachingunmatched
  • Writing Skillsunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder