Rose International logo

Risk Analyst

Rose International

  • New York, New York
  • 13 days ago
  • $42–$47 Per Hour
  • Temporary
Want to know if you’re a fit?
Upload your resume and let our AI show you.

Skills

  • Artificial Intelligence (AI)unmatched
  • Audiovisualunmatched
  • Benchmarkingunmatched
  • Business Operationsunmatched
  • Communication Skillsunmatched
  • Computer Securityunmatched
  • Constructionunmatched
  • Creative Writingunmatched
  • Cross-Functionalunmatched
  • Customer/Consumer Behaviorunmatched
  • Data Modelingunmatched
  • Establish Prioritiesunmatched
  • Machine Toolunmatched
  • Modeling Languagesunmatched
  • Presentation/Verbal Skillsunmatched
  • Psychiatry and Mental Healthunmatched
  • Psychologyunmatched
  • Riskunmatched
  • Risk Analysisunmatched
  • Scripting (Scripting Languages)unmatched
  • Social Engineeringunmatched
  • Special Educationunmatched
  • Stress Testingunmatched
  • Surface Modelingunmatched
  • Taxonomiesunmatched
  • Test Caseunmatched
  • Test Designunmatched
  • Test Harnessunmatched
  • Training Data Setsunmatched
  • Writing Skillsunmatched

Description

AI Red TeamerJob Description Client Location: Onsite in New York (zip code 10001) Potential Exposure to Objectionable/Sensitive/Graphic Content Education Required: Bachelor's degree preferred but not required Required Experience Must have at least 3 years Red teaming specialist Adversarial Prompting Mindset: A natural inclination to think like an attacker and push systems to their limits. You should find genuine satisfaction in discovering unexpected failure modes Creative & Narrative Construction — ability to build compelling multi-turn scenarios that exploit linguistic nuance Creative and Psychological Insight: Background in creative writing, humanities, mental health counseling, psychology, or special education — with a demonstrated ability to construct compelling narratives, exploit linguistic nuance, and identify psychological vulnerabilities Adaptability: Comfort switching between modalities (text, image, audio, video) and rapidly adjusting to new model behaviors, testing priorities, and task types Communication Skills: Excellent written and verbal communication skills, with the ability to document and explain complex vulnerabilities clearly to both technical and non-technical audiences Resilience and Balance: Capacity to sustain well-being while engaging in psychologically demanding work. This role involves regular exposure to graphic and objectionable content, including violence, exploitation, and self-harm scenarios. Comprehensive wellness support is provided Preferred Qualifications Prior experience in professional red teaming, trust & safety, data annotation, or socio-technical risk analysis Familiarity with large language models (LLMs) and generative AI products such as ChatGPT, Claude, or Gemini Basic technical skills in prompt engineering, encoding techniques (e.g., Base64, ROT13), or scripting to complement creative attack vectors Knowledge of AI safety concepts, including RLHF, alignment, and model evaluation frameworks Unlike automated testing, which handles baseline coverage and known attack patterns efficiently, this role focuses on the ~40% of vulnerabilities that require human ingenuity, psychological insight, and creative out-of-distribution thinking. You will interact with our models across text, image, audio, and video modalities to uncover weaknesses, evaluate actual output harm, and stress-test our systems against novel adversarial attacks. This is intense, high-impact work at the frontier of AI safety — and it offers direct influence on how Client AI systems behave in the real world. Position Summary: What You'll Do Creative Adversarial Testing Design and execute novel, multi-turn adversarial attacks — including emotional manipulation, roleplay, social engineering, and authority exploitation — to bypass model safeguards and surface harmful capabilities. Vulnerability Assessment Evaluate model outputs for actual harm and real-world risk, not just policy violations. Apply Client user risk taxonomy to prioritize testing across user types, from casual users to agentic systems. Agentic and Emerging Threat Testing Probe for agentic vulnerabilities such as privilege escalation, indirect prompt injection, and scope creep in multi-authority systems — the next frontier of AI risk. Data Annotation and Reporting Generate high-quality human evaluation data by annotating model failures, classifying vulnerabilities, and producing reproducible adversarial test cases that engineering and safety teams can act upon. Cross-Functional Collaboration Partner with AI researchers, engineers, and domain experts to translate findings into actionable improvements. Contribute to refining our red teaming taxonomy, benchmarks, and tooling infrastructure. Continuous Learning Stay current with evolving adversarial techniques, internet subcultures, and AI safety research to continuously sharpen your attack strategies. What We're Looking For We actively seek candidates from non-traditional backgrounds. Our most effective red teamers come from creative, humanities, mental health, and special education fields — not exclusively from technical roles. Important Notice Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation.

Numbers & Facts

LocationNew York, New York
Job TypeTemporary
IndustryStaffing/Employment Agencies
Salary$42–$47 Per Hour
Company Size2,500 to 4,999 employees
Websitehttps://www.roseint.com/

About Company

Founded in 1993 by Sue Bhatia, Rose International is one of the nation's leading minority- and woman-owned providers of Staffing and Total Talent Solutions. We serve companies in all 50 states and employ thousands of people across the country.

Similar Jobs

See more jobs