Program Manager - Content QA

The Andersen Agency

Redmond, Washington(remote)

JOB DETAILS
SKILLS
Analysis Skills, Artificial Intelligence (AI), Automation, Bug Tracking/Defect Management, Communication Skills, Computer Science, Content Development, Cross-Functional, Customer Experience, Customer Relations, Detail Oriented, Documentation, Ecosystems, Identify Issues, Information Technology & Information Systems, Multiplatform/Cross-Platform, Performance Analysis, Performance Modeling, Precision Testing, Problem Solving Skills, Process Improvement, Project/Program Management, Python Programming/Scripting Language, Quality Assurance, Quality Assurance Methodology, Quality Metrics, Reporting Skills, Scripting (Scripting Languages), Test Automation, Test Case, Test Plan/Schedule, Test Scripts, Testing, Time Management, Usability Engineering, Usability Testing, User Interface/Experience (UI/UX), Validation Documentation, Windows PowerShell
LOCATION
Redmond, Washington
POSTED
6 days ago

163085-1

Job Title: Program Manager Content QA

Location: Remote (Candidates must be available to work Pacific Time hours)

Rate: $38-$40 hourly

Duration: August 3, 2026 through December 31, 2026 (w/potential for extension)


This role supports a high-impact content quality and AI evaluation team focused on delivering high-quality, reliable content experiences across productivity platforms. The Quality Analyst will validate AI-generated outputs, assess content performance, and ensure consistency across templates, prompt-based content, and emerging AI-driven experiences.

This position plays a key role in improving customer experience by driving quality assurance processes for next-generation content solutions.


Required Skills & Qualifications

Education

  • Bachelor’s degree in Computer Science, Engineering, Information Systems, Content Automation, or a related technical field

Experience

  • Proven experience in quality assurance, content testing, or usability testing
  • Demonstrated ability to create test plans, test cases, and test reporting documentation
  • Experience working with structured testing methodologies and quality frameworks

Core Skills

  • Strong analytical and problem-solving capabilities
  • Experience with scripting languages such as Python, PowerShell, or similar
  • Understanding of productivity tools and digital content ecosystems
  • Ability to communicate complex findings clearly to technical and non-technical stakeholders
  • Strong attention to detail with a focus on content accuracy and user experience

Candidate Requirements

  • Consistent employment history demonstrating stability and reliability
  • Ability to work aligned to Pacific Time hours in a remote environment
  • Supplier-provided equipment (standard PC required)
  • Strong communication skills with the ability to articulate testing outcomes and recommendations

Assessment Process

  • One to two interview rounds (30 to 45 minutes each)
  • Technical and experiential evaluation focused on:
  • Quality assurance methodologies
  • Content testing experience
  • Test planning and reporting capabilities
  • Candidates should be prepared to discuss prior projects and demonstrate applied experience

Performance Measurement

Success in this role will be evaluated based on:

  • Volume and quality of executed test cases
  • Effectiveness and accuracy of test coverage
  • Timely delivery against milestones and deadlines
  • Proactive communication regarding risks and blockers
  • Ability to translate data into clear, actionable insights and recommendations


Key Responsibilities

Content Testing and Quality Assurance

  • Develop and execute test plans for templates, prompt templates, and AI-generated content
  • Perform manual and automated testing across productivity applications and content experiences
  • Validate content quality, usability, accessibility, functionality, and visual/design alignment
  • Identify, document, and track defects through resolution

AI Content Evaluation

  • Evaluate AI-generated outputs against predefined quality standards
  • Assess accuracy, formatting, usability, and overall effectiveness
  • Provide actionable recommendations to improve content and model performance

Test Development and Execution

  • Create and maintain test cases, scripts, validation frameworks, and documentation
  • Establish scalable and repeatable testing methodologies
  • Collaborate with cross-functional teams to identify automation opportunities

Reporting and Insights

  • Analyze test results and communicate findings to stakeholders
  • Identify recurring issues, trends, and improvement opportunities
  • Ensure findings are reflected in documentation and ongoing workflows


Unique Selling Points

  • Opportunity to influence and validate next-generation content and AI-driven experiences
  • Direct impact on large-scale customer-facing productivity tools and platforms
  • Exposure to advanced AI content workflows and evaluation methodologies
  • Cross-functional collaboration with content, engineering, and product teams
  • Ability to drive improvements that enhance both content quality and user experience at scale


About the Company

T

The Andersen Agency