Job Description
We are looking for a talented Software Development Manager to lead the team that powers A/B testing at Amazon, guiding builders from setup through execution, analysis, launching, reporting, and learning. The team owns the experimentation process end-to-end, driving Amazon"s innovation cycle through rapid evaluation of ideas. The manager of this team is the single threaded owner of the experimentation process.
Key job responsibilities
Work backwards from customers. The experimentation leader is the single threaded owner of running randomized experiments at Amazon. The SDM must closely understand the customer problems to ensure we"re working backwards from the most critical customer needs.
Work closely with Science. Weblab is fundamentally a science and engineering product with neither able to operate at maximum effectiveness without the other.
Relentlessly Prioritize. The team will receive far more asks for things to build and to support away teams than we can feasibly support.
Trade off technical decisions. The team will be faced with high stakes technical tradeoff decisions. The SDM needs to listen to the opinions and recommendations of their tech leads while being able to make a clear decision.
Manage large scale operations. The scale of the operations of the team is massive, both in terms of analyses run but also distinct teams and users. Small bugs can create massive headaches if they aren"t caught or we don"t have systems to detect issues and respond quickly.
A day in the life
Within the team we have a capable mix of developers at all points in their careers. The developers tend to be attracted to the hard scaling problems, and the complex user-experience required to guide people through statistical reasoning. The team also works closely with scientists who work on hard problems around causal inference and how to tease out quiet signals from a wealth of noise across disparate groups in Amazon. Weblab powers hundreds of thousands of experiments per year ran by tens of thousands of unique users each with their own needs and requirements.
About the team
Amazon's Weblab team provides experiment based support to launch product changes, make product decisions, and evaluate the impact on customers. A/B testing is in Amazon's DNA, and we are at the core of how Amazon innovates on behalf of customers. Be part of the team that helps Amazonians uncover the real impact of product changes to avoid accidental harm to customers or the business.
Numbers & Facts
| Location | Seattle, WA |
| Industry | Retail |
| Company Size | 10,000 employees or more |
| Year Founded | 1994 |
| Website | http://Amazon.com/militaryroles |
About Company
At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life.
Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.
It’s Always Day 1
At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here
Our Leadership Principles
Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles
Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.
It’s Always Day 1
At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here
Our Leadership Principles
Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles
Skills
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesFree resume builder
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder