Remote | Russian Audio AI Evaluator — Up to $45/hour

24-Mag
  • New York, New York
  • Remote
    4 days ago

    Job Description

    We are sharing a specialised part-time consulting opportunity for Russian-language professionals with strong transcription, editing, analytical, and critical-listening skills to support advanced audio AI research.

    This role focuses on transcription, annotation, and evaluation of Russian-language audio and video content for AI training and benchmarking. Selected professionals will assess linguistic accuracy, develop evaluation standards, review model-generated outputs, and help improve the quality of Russian audio AI systems.

    Key Responsibilities

    Russian Audio Transcription & Annotation

    • Listen to, analyse, and transcribe Russian-language audio and video content
    • Produce accurate written outputs in Russian, with supporting work in English when required
    • Follow detailed transcription, formatting, and annotation guidelines
    • Capture tone, intent, register, regional expressions, dialectal variation, and contemporary language usage
    • Maintain high accuracy and consistency across structured audio datasets

    Language & Audio Evaluation

    • Evaluate Russian-language content for linguistic accuracy, fluency, clarity, and naturalness
    • Identify grammatical issues, colloquialisms, regional variations, and linguistic edge cases
    • Assess spoken Russian across general consumer audio contexts
    • Distinguish between formal and informal registers and evaluate context-appropriate language use
    • Provide structured feedback on language and transcription quality

    Evaluation Standards & Rubric Development

    • Develop clear evaluation criteria for high-quality Russian-language audio responses
    • Create and refine grading rubrics in Russian and English
    • Document evaluation standards to support consistency across reviewers
    • Identify challenging linguistic cases requiring additional guidance
    • Contribute to the refinement of annotation and evaluation frameworks

    AI Model Testing & Quality Assurance

    • Test language-model outputs across Russian audio tasks
    • Evaluate responses for accuracy, completeness, fluency, and instruction adherence
    • Grade model-generated outputs against defined evaluation criteria
    • Participate in quality-assurance and review cycles
    • Identify recurring model errors and provide feedback to improve performance
    • Collaborate with project teams to resolve ambiguities and improve task design

    Ideal Profile

    • Native or near-native fluency in Russian, both spoken and written
    • Professional fluency in English
    • Strong familiarity with contemporary spoken Russian, regional vocabulary, dialects, and informal language
    • Ability to accurately transcribe and analyse Russian-language audio
    • Strong writing, editing, analytical, and critical-thinking skills
    • Excellent attention to linguistic detail and ability to follow detailed guidelines
    • Prior experience with transcription, annotation, localisation, language evaluation, or research workflows is advantageous
    • Background in linguistics, humanities, social sciences, journalism, translation/localisation, or a technical discipline is welcomed
    • Familiarity with AI, language models, or applied research environments is advantageous
    • Must be based in the San Francisco Bay Area
    • Available approximately 10–20 hours per week

    Engagement Details

    • Part-time independent contractor engagement
    • Short-term, structured project
    • Fully remote, with occasional in-person collaboration in the San Francisco Bay Area if required
    • Compensation: Up to $45/hour
    • Approximately 10–20 hours per week
    • Flexible scheduling based on project requirements
    • Projects may be extended, shortened, or concluded based on project needs and performance
    • Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
    • H1-B and STEM OPT support is unavailable for this engagement

    About the Platform

    This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

    By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.

    Numbers & Facts

    LocationNew York, New York (
    Remote
    )
    Website4-mag.com/privacy-policy

    Skills

    • Analysis Skillsunmatched
    • Artificial Intelligence (AI)unmatched
    • Artificial Intelligence (AI) Programming Languagesunmatched
    • Audiovisualunmatched
    • Benchmarkingunmatched
    • Consultingunmatched
    • Data Setsunmatched
    • Detail Orientedunmatched
    • Documentation Standardsunmatched
    • Editingunmatched
    • English Languageunmatched
    • Identify Issuesunmatched
    • Linguisticsunmatched
    • Localizationunmatched
    • Model Reviewunmatched
    • Modeling Languagesunmatched
    • Performance Managementunmatched
    • Productivity Managementunmatched
    • Project Evaluationunmatched
    • Project Scheduleunmatched
    • Quality Assuranceunmatched
    • Quality Managementunmatched
    • Russian Languageunmatched
    • Science Journalismunmatched
    • Social Sciencesunmatched
    • Standards Developmentunmatched
    • Technical Consultingunmatched
    • Writing Skillsunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder