Job Description
Continuum is autonomous security at machine speed: discover, validate, prioritize, and remediate code vulnerabilities. You will own the evaluation and release systems that determine what ships and when.
What we"re looking for
Strong engineering fundamentals with experience in ML or evaluation infrastructure
Hands-on experience with experiment design, A/B testing, or online evaluation
Comfort at the boundary of research and production
Experience with agent systems, LLM evaluation, or ML pipelines is a plus
Key job responsibilities
Production evaluation systems
Build automated pipelines that evaluate changes to Continuum"s models, prompts, tools, and agent architecture. Provision realistic environments, run deployed agents, grade results, and compare candidates against baselines. Design for asynchronous, nondeterministic agent behavior. Create reusable workflows so new capabilities follow a standard evaluation and release path.
Online experiments and release decisions
Design Continuum"s A/B testing and online evaluation system. Support shadow evaluation, canary releases, and controlled experiments. Build treatment assignment, exposure logging, guardrail metrics, stopping criteria, and rollback. Define metrics for quality, safety, latency, cost, and reliability. Build dashboards that surface regressions and produce readouts that explain what changed and what to monitor post-launch.
Shipping agent capabilities
Turn prototypes into production features alongside scientists and security engineers. Package changes to models, prompts, tools, planning, memory, and agent coordination behind stable interfaces. Own science-side integration end to end: APIs, data contracts, versioning, telemetry, release tests, and production requirements for tenancy, durability, scaling, and failure recovery.
Numbers & Facts
| Location | Seattle, WA |
| Industry | Retail |
| Company Size | 10,000 employees or more |
| Year Founded | 1994 |
| Website | http://Amazon.com/militaryroles |
About Company
At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life.
Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.
It’s Always Day 1
At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here
Our Leadership Principles
Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles
Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.
It’s Always Day 1
At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here
Our Leadership Principles
Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles
Skills
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesResume Builder
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Resume Builder