Remote

We are sharing a specialised full-time consulting opportunity for US-based senior retail professionals with deep experience in merchandising, category management, buying, planning, retail operations, and structured evaluation of AI-generated outputs.

This role supports a high-impact generative AI initiative focused on improving how advanced models reason through real-world retail challenges. Selected professionals will design rigorous retail tasks, evaluate model outputs against structured criteria, develop scoring frameworks, and provide practical feedback grounded in senior-level merchandising, category, planning, and operational experience.

Key Responsibilities

Retail Strategy & Domain Guidance

• Guide research and engineering teams on merchandising, category management, assortment planning, buying, and retail operations
• Identify gaps in model understanding across pricing, inventory, promotions, customer demand, store performance, and commercial planning
• Apply practical retail judgment to complex scenarios involving products, channels, suppliers, customers, and financial objectives
• Ensure retail tasks reflect realistic business decisions and current industry practices

Retail Task & Solution Development

• Design challenging, domain-relevant tasks grounded in real retail practice
• Write accurate, well-reasoned solutions covering merchandising, category, buying, planning, and operational scenarios
• Develop problems requiring commercial judgment, prioritisation, data interpretation, and evaluation of competing trade-offs
• Ensure tasks are clear, internally consistent, and suitable for structured assessment

AI Output Evaluation

• Evaluate AI-generated retail responses against established rubrics and scoring criteria
• Assess correctness, commercial judgment, reasoning quality, relevance, and practical applicability
• Compare alternative outputs and determine which response provides the stronger retail recommendation
• Identify factual errors, unsupported assumptions, weak commercial reasoning, and incomplete conclusions
• Provide clear written feedback that supports improvements in model behaviour

Rubric Development & Quality Calibration

• Develop and refine evaluation guidelines for merchandising, category management, planning, and retail operations tasks
• Define scoring criteria covering technical accuracy, commercial judgment, reasoning, and execution feasibility
• Participate in calibration activities with other retail specialists
• Collaborate across teams to maintain consistency and accuracy throughout the training data

Ideal Profile

Strong candidates may have:

• At least 8 years of dedicated professional experience in retail
• Senior-level expertise in merchandising, category management, buying, planning, retail operations, or a related area
• Experience working within a recognised retailer, consumer brand, e-commerce platform, or comparable organisation
• Prior hands-on experience evaluating LLM or AI-generated outputs using structured rubrics or scoring criteria
• Demonstrable career progression into senior manager, director, vice president, or comparable leadership responsibilities
• Strong commercial judgment and the ability to assess complex retail decisions
• Excellent written and verbal communication skills
• Reliable availability for at least 35 hours per week during weekdays

Educational Background

• A degree in business administration, retail management, merchandising, supply chain, marketing, economics, or a related field is highly relevant
• Graduate-level education in business, strategy, operations, analytics, or management may be helpful
• Equivalent senior professional experience in retail strategy or operations may also be considered
• Professional training in category management, merchandising analytics, procurement, or commercial planning may be valuable

Nice to Have

• Experience working with large-scale retailers, global consumer brands, or high-growth e-commerce businesses
• Background in omnichannel retail, marketplace operations, inventory planning, or store operations
• Experience creating structured scoring rubrics, evaluation guidelines, or quality frameworks
• Familiarity with model training, human-feedback workflows, annotation, or AI quality assurance
• Strong understanding of pricing, assortment, promotions, forecasting, inventory, and margin management
• Experience reviewing category plans, buying strategies, merchandising proposals, or operational performance reports
• Previous collaboration with product, analytics, supply chain, marketing, finance, or technical teams

Why This Opportunity

• Apply senior retail expertise to an advanced generative AI initiative
• Influence how AI systems reason about merchandising, category management, and retail operations
• Design and assess challenging retail problems grounded in practical commercial experience
• Collaborate with technical teams and experienced retail specialists
• Join a full-time remote engagement with competitive hourly compensation

Contract Details

• Full-time W-2 contingent employment arrangement
• Fully remote role available to candidates based in the United States
• Expected commitment of at least 35 hours per week during weekdays
• Competitive rates between $55–$75 per hour depending on expertise and project scope
• Prior experience evaluating AI or LLM outputs against structured rubrics is required
• Applicants should clearly describe relevant AI evaluation experience in their application
• Immediate availability is preferred
• Work may include onboarding, specialty calibration, task development, and ongoing quality review
• Project scope and duration may be adjusted according to programme requirements and performance

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.