AI Agent Power User - Remote

YO AI Labs
  • San Francisco, CA
  • Remote
    1 day ago

    Job Description

    AI Agent Power User

    Role Type: Contractor
    Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand

    We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows.

    You'll use your professional experience and hands-on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.

    Scope of Work

    • Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
    • Document workflows and identify where AI performance meets or falls short of real business requirements.
    • Evaluate AI-generated outputs using defined rubrics and quality criteria.
    • Provide clear, actionable feedback to AI research and product teams.
    • Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
    • Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
    • Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

    Preferred Qualifications

    • 5+ years of professional experience in any business function involving technology and operational problem-solving.
    • Bachelor's degree or higher in any discipline.
    • Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
    • Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
    • Comfortable working with AI tools and common workplace productivity platforms.
    • Excellent written English and strong documentation skills.
    • Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.

    Numbers & Facts

    LocationSan Francisco, CA (
    Remote
    )

    Skills

    • Artificial Intelligence (AI)unmatched
    • Documentationunmatched
    • English Languageunmatched
    • Google Appsunmatched
    • Problem Solving Skillsunmatched
    • Process Improvementunmatched
    • Quality Assuranceunmatched
    • Scorecardingunmatched
    • Slackunmatched
    • Test Scenariounmatched
    • Test Toolsunmatched
    • Writing Skillsunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder