We are sharing a specialised part-time consulting opportunity for experienced Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, and Data Analytics professionals to contribute domain expertise to an advanced AI training and evaluation project focused on analytical reasoning, data quality, prompt development, technical communication, and model-output assessment.
Selected professionals will review AI-generated analytical content, develop and refine prompts, assess outputs against structured rubrics, conduct research and fact checking, and translate complex findings into clear technical and business-facing conclusions. No prior experience in AI training is required.
Key Responsibilities
AI Evaluation & Analytical Review
- Review AI-generated analytical content for accuracy, clarity, relevance, and logical consistency
- Evaluate outputs against structured rubrics and professional analytical standards
- Identify quantitative, factual, or interpretive weaknesses
- Apply professional judgement to ambiguous or technically complex cases
- Provide clear written rationales supporting evaluation decisions
Prompt Development, Data & Research
- Develop and refine prompts for complex data-science and analytical tasks
- Design scenarios that test quantitative reasoning and data interpretation
- Interpret datasets, experiments, notebooks, and analytical outputs
- Conduct independent research and fact checking to validate technical claims
- Annotate data and identify recurring quality issues across evaluation workflows
Technical Writing & Quality Assurance
- Produce and review research summaries, analytical reports, experiment findings, and technical documentation
- Translate quantitative findings for both technical and business audiences
- Review labelled examples and model outputs for consistency and quality
- Support calibration across contributors and evaluation standards
- Collaborate asynchronously with project leads and other domain specialists
Ideal Profile
- 3+ years of professional experience in Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, Data Analytics, or a comparable analytical discipline
- Strong analytical reasoning and quantitative interpretation skills
- Experience producing or reviewing research papers, analytical reports, experiment summaries, notebooks, or technical documentation
- Exceptional attention to detail and strong professional writing ability
- Ability to communicate technical and quantitative concepts clearly
- Strong independent research and fact-checking skills
- Experience with data annotation, content review, or rubric-based evaluation is highly desirable
- Prompt engineering or prompt-authoring experience is advantageous
- Familiarity with AI-output evaluation, model-quality assessment, or RLHF is beneficial but not required
- Master's, MBA, PhD, or another advanced degree is preferred but not required
- Experience in leading technology companies, research organisations, or similarly rigorous analytical environments is valuable
- No prior AI-training experience is required
Engagement Details
- Part-time independent contractor engagement
- Fully remote
- Compensation: $100–$200/hour
- Work will involve data-science analysis, AI-output evaluation, prompt development, rubric-based review, data annotation, quality assurance, research, fact checking, and technical writing
- Assignments may involve research papers, analytical reports, experiment summaries, datasets, notebooks, technical documentation, model outputs, and evaluation rubrics
- Collaboration will primarily occur asynchronously with project leads and other subject-matter experts
- Prior experience with prompt engineering, AI evaluation, or RLHF is helpful but not required
- Project scope, workload, analytical topics, and evaluation standards may evolve depending on project requirements
- Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, research organisation, or other third party
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy