UNKNOWN

FEED

Practical experience with AI/LLM evaluation frameworks (e.g., Ragas, DeepEval, LangSmith, Promptfoo, OpenAI Evals, TruLens) - building eval suites, scoring rubrics, and golden datasets. Working knowledge of eval metrics for generative AI: hallucination rate, faithfulness/groundedness, relevance, answer correctness, toxicity/bias scoring, BLEU/ROUGE/semantic similarity where applicable.

Sumeru Solutions

QA Engineer for AI Products/Solutions

Ceipal

We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. We're looking for Executive Assistants to join our Expert Network to help train and evaluate cutting-edge AI models using their administrative expertise.

HOUR

Prolific Academic Ltd

AI Training - Executive Assistant - Seattle, US

GreenHouseAPI

A successful candidate will bring a passion for technology services, strong business acumen and judgment, proven experience of launching products and building business around them, ability to define ground breaking products, desire to have an industry wide impact and ability to work within a fast moving environment in a large company to rapidly deliver services that have a broad business impact. Your responsibilities will include: Lead Product Definition - Own and drive the customer working backwards strategy, tenets, long-term goals and working backwards documents (press release, FAQ) including customer and market feedback, competitive analysis and business metrics to inform direction.

At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life. 
Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet. 
It’s Always Day 1 
At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter <a href="https://hiring.amazon.com/why-amazon/culture#/">here</a> 
Our Leadership Principles 
Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit <a href="https://www.amazon.jobs/principles" target="_blank">https://www.amazon.jobs/principles</a>

Online Sales Jobs in Union, NJ

QA Engineer for AI Products/Solutions Sumeru Solutions

AI Training - Executive Assistant - Seattle, US Prolific Academic Ltd

Sr. PMT - ES, Healthcare AI, AWS Healthcare AI Amazon.com Inc

Similar Job Searches

Get noticed by top employers!