We are sharing a specialised consulting opportunity for experienced QA Engineers, Software Engineers, SDETs, and Test Automation Engineers with strong expertise in browser automation and modern web application testing.
This role supports an advanced AI initiative focused on validating browser-based testing workflows for AI-generated web applications. Selected professionals will review automated tests for technical feasibility, determinism, reliability, isolation, and clear pass/fail behaviour before those workflows are incorporated into evaluation datasets.
Key Responsibilities
Browser Test Validation
- Review browser-based testing workflows for modern web applications
- Assess whether browser interactions are technically feasible and reliably executable
- Verify that test sequences accurately represent intended user interactions
- Identify workflows that may produce inconsistent or misleading results
- Evaluate overall technical quality before tests are approved for use
Test Automation Review
- Review automated UI and end-to-end testing implementations
- Evaluate workflows built with Playwright, Cypress, Selenium, or comparable browser automation frameworks
- Assess test setup, fixtures, dependencies, and execution order
- Identify unnecessary coupling between tests or hidden environmental dependencies
- Verify that automated tests can be reproduced consistently
Reliability & Determinism
- Confirm that assertions generate clear and unambiguous pass/fail outcomes
- Identify flaky tests and sources of nondeterministic behaviour
- Evaluate test isolation and state management
- Review timing, asynchronous behaviour, selectors, and other common sources of browser-test instability
- Ensure validation logic accurately measures the intended application behaviour
Technical Review & Feedback
- Debug problematic testing workflows and identify underlying technical issues
- Assess whether test failures represent genuine application problems or weaknesses in the test itself
- Provide structured technical feedback according to established review criteria
- Document errors, ambiguities, and reliability concerns clearly
- Apply consistent software-quality judgment across repeated evaluations
Ideal Profile
Strong candidates may have:
- At least 3 years of professional experience in QA Engineering, Software Engineering, SDET, Test Automation, or a closely related role
- Strong experience testing modern web applications
- Hands-on experience with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools
- Experience writing automated UI and end-to-end tests
- Strong understanding of test isolation, fixtures, reproducibility, and deterministic testing
- Ability to identify flaky tests, hidden dependencies, and ambiguous assertions
- Excellent debugging and technical problem-solving skills
- Strong attention to detail and written communication
Educational Background
- A degree in computer science, software engineering, information technology, or a related technical discipline may be helpful
- Equivalent professional experience in software testing or quality engineering may also be considered
- Practical experience designing and maintaining production-grade automated test suites is particularly valuable
Nice to Have
- Advanced experience with Playwright
- Experience with Cypress or Selenium
- Background designing browser automation frameworks
- Experience testing complex single-page applications
- Familiarity with CI/CD-based automated testing
- Knowledge of test environments, fixtures, mocks, and state management
- Experience reviewing or maintaining large automated testing suites
- Prior experience with AI evaluation, benchmark development, or structured technical review
Why This Opportunity
- Apply professional QA and test automation expertise to advanced AI evaluation
- Review realistic browser-testing workflows for modern web applications
- Help establish reliable quality standards for AI-generated software evaluation
- Identify subtle sources of flakiness, ambiguity, and nondeterministic behaviour
- Work across browser automation, test design, debugging, and software quality engineering
- Participate in flexible remote consulting work with competitive hourly compensation
Contract Details
- Independent contractor role
- Fully remote with flexible scheduling
- Competitive rates between $25–$55 per hour depending on expertise and project scope
- Work may include browser-test review, automation validation, debugging, reliability assessment, and structured technical feedback
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or adjusted depending on scope and performance
- Work will not involve access to confidential or proprietary information from any employer, client, or institution
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.