Growth Product Design Evaluator - Experimentation - Part-Time

Pride Technologies LLC
  • CA
  • Remote
  • $170–$195 Per Hour
17 days ago

Job Description

Growth Product Design Evaluator - Experimentation

Part-Time W2 Contract | Fully Remote - U.S.

Pay: $170-$195/hour W2

Schedule: Approximately 2-3 hours per day, with flexibility around when the work is completed

Contract: Through the end of the year, with potential to extend

Employer: Russell Tobin, supporting a leading high-growth AI company

Russell Tobin is partnering with a leading AI technology company to hire a Growth Product Design Evaluator for a specialized, part-time engagement supporting its growth organization.

We are not looking for product design experience broadly. We are looking for designers who have developed strong instincts around incremental growth product design and experimentation - the work of evaluating whether relatively small changes to a page, flow, or interaction are likely to improve measurable product outcomes.

The growth team runs a high volume of experiments, many of which begin as AI-generated design treatments. Your role will be to review those treatments, determine what works and what does not, and clearly explain why.

Your evaluations will help train and improve an automated design reviewer, which means consistency, judgment, and clear reasoning matter more than speed or volume.

What This Role Is

This is primarily design evaluation and labeling work.

You will not be creating comps, owning product surfaces, or building new experiences from scratch. Instead, you will repeatedly review generated design treatments and use your product judgment, growth instincts, and experimentation experience to help improve them.

You should genuinely enjoy evaluating other people's-or AI-generated-work without needing to be the person creating the final design.

What You'll Do

  • Review growth-oriented design treatments against a written design bar and set of guidelines
  • Score and label treatments using an internal review tool
  • Determine whether a proposed treatment is strong or weak and explain why
  • Write short, useful critiques when a decision requires additional context
  • Think beyond the options presented and identify stronger potential approaches when appropriate
  • Flag recurring design mistakes, gaps in existing guidelines, and cases the current rules do not adequately address
  • Apply consistent judgment across a high volume of similar evaluations
  • Participate in a short weekly calibration session with the Head of Design for the growth organization
  • Help translate strong product judgment into feedback that can improve an automated design-review system

Who We're Looking For

Direct growth or experimentation experience is essential.

You have worked directly on a growth, conversion, optimization, or experimentation-heavy product team.

Being adjacent to a growth team is not enough.

This is the strongest signal we are looking for, regardless of seniority. Incremental conversion and experimentation work requires a different set of instincts than brand design, marketing design, or primarily 01 product design.

You should also have:

  • Hands-on experience running, supporting, or analyzing A/B tests yourself
  • Experience using quantitative results to evaluate product or design decisions
  • The ability to describe specific experiments you have worked on, including the metric being measured and the actual result
  • Strong product judgment and the ability to reason through why one treatment may outperform another
  • Comfort making predictions based on data and being proven wrong by experiment results
  • The ability to give specific, actionable feedback rather than broad or subjective design commentary
  • Strong written communication, particularly the ability to make a useful point briefly
  • Comfort performing repetitive evaluation work with consistency and attention to detail
  • No ego around reviewing, grading, or critiquing work created by someone-or something-else

What Strong Experience Looks Like

We are especially interested in candidates who can talk concretely about experiments they have worked on.

For example:

  • What was the hypothesis?
  • What did you change?
  • What metric were you trying to move?
  • How was the experiment structured?
  • What actually happened?
  • What did you learn from the result?

Strong candidates can connect their design decisions to specific metrics and measurable outcomes, rather than describing a redesign simply as a successful launch or portfolio win.

Nice to Have

  • Experience writing or maintaining design guidelines, heuristics, quality bars, or review rubrics
  • Experience working on high-volume experimentation programs
  • Experience evaluating multiple treatment variations against consistent criteria
  • Familiarity with AI-assisted product or design workflows

This Probably Isn't the Right Fit If

  • Your background is primarily in brand, marketing, visual, or creative design
  • Most of your experience is traditional product design without direct growth experimentation ownership
  • You have collaborated with experimentation teams but have not personally run or analyzed A/B tests
  • Your strongest examples focus on launches, redesigns, or portfolio work without measurable experiment outcomes
  • You are primarily looking for an opportunity to create original designs, own a product area, or build a portfolio
  • You would find several hours of recurring design evaluation and labeling frustrating or monotonous

#RTA

#LI-BK1

For workers in the United States, PrideGlobal and it's affiliates offers eligible employee's comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance and hospital indemnity), 401(k)-retirement savings, life & disability insurance, an employee assistance program, legal support, pet insurance and employee discounts with preferred vendors.

Equal Employment Opportunity

PrideGlobal and it's affiliates are an equal opportunity employer. We do not discriminate on the basis of the race, religious creed, color, national origin, ancestry, physical disability, mental disability, reproductive health decision making, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, age, sexual orientation, veteran or military status, or any other characteristic protected by applicable federal, state, or local law.

Fair Chance Employment

PrideGlobal and it's affiliates are a Fair Chance employer. We consider all qualified applicants, including those with criminal histories, in a manner consistent with applicable state and local Fair Chance laws and ordinances, including, the California Fair Chance Act and all applicable local Fair Chance ordinances.

Accommodations

We are committed to providing reasonable accommodations to applicants and employees with disabilities. If you require a reasonable accommodation to participate in the application or interview process, or to perform the essential functions of this role, please contact us.

Only applicable for San Francisco Candidates: Under the San Francisco Lactation in the Workplace Ordinance, we will provide written notice of lactation accommodation rights, and this notice will automatically be given upon hiring, any inquiry of parental leave or lactation accommodation.

Only applicable for Kentucky positions: For this type of employment, state law requires a criminal record check as a condition of employment. This applies to direct care staff (Examples: RN, LPN, Nurse Aides, Therapists) referred to Kentucky nursing facilities, assisted living communities, or long-term care facilities, in accordance with KRS 216.793.

Numbers & Facts

LocationCA (
Remote
)
Salary$170–$195 Per Hour

Skills

  • A/B Testingunmatched
  • Analysis Skillsunmatched
  • Artificial Intelligence (AI)unmatched
  • Brand Marketing (Branding)unmatched
  • Calibrationunmatched
  • Creative Designunmatched
  • Design Evaluationunmatched
  • Design Servicesunmatched
  • Detail Orientedunmatched
  • Interaction Flow Diagramunmatched
  • Metricsunmatched
  • Organizational Development/Managementunmatched
  • Product Designunmatched
  • Product Testingunmatched
  • Quantitative Analysisunmatched
  • Treatment Evaluationunmatched
  • Website Conversionunmatched
  • Writing Skillsunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder