Primary Skills: Google Ads (Expert), Rubric Evaluation (Intermediate), Transcript Reviewing (Expert), AI (Intermediate), ChatBot Transcripts (Expert)
Contract Type: W2/C2C only
Duration: 6+ Months Contract (High possibility of extension)
Location: 100% Remote
Pay Range: $28 - $33 Per Hour on W2
Job Summary: We are seeking evaluators to assess AI-generated marketing conversations, specifically focusing on the quality and effectiveness of interactions between advertisers and a marketing advisor AI agent. Candidates should possess a deep understanding of Google Ads and its campaign management, including conversion tracking and troubleshooting. This remote position requires a commitment of 20 hours per week.
Key Responsibilities:
Evaluate conversation transcripts against defined rubrics.
Assess key metrics such as helpfulness and accuracy.
Compare evaluations between raters to validate auto-rater performance.
Conduct supplemental spot-checking of transcripts to identify emerging trends.
Participate in weekly alignment meetings to reach agreement on ratings
Must-Have Skills:
Extensive experience with Google Ads or similar advertising platforms.
Experience Reviewing AI Transcripts and evaluating the quality and Rubrics
Excellent communication skills for articulating findings and trends.
Prior experience in advertising and marketing is required, especially with Google Ads.
ABOUT AKRAYA Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Stevie Employer of the Year 2025, SIA Best Staffing Firm to work for 2025, Inc 5000 Best Workspaces in US (2025 & 2024) and Glassdoor's Best Places to Work (2023 & 2022)!
Industry Leaders in Tech Staffing
As Talent solutions provider for Fortune 100 Organizations, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!
Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!