Staff Machine Learning Engineer, Responsible AI Engineering Visa Technology and Operations LLC
Foster City, CA12 days ago
- $169,100–$270,800 Per Year
Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron
Amazon.com Inc
- Cupertino, CA
- 5 days ago
Want to know if you’re a fit?
Upload your resume and let our AI show you.
Upload your resume and let our AI show you.
Skills
- Amazon Web Services (AWS)unmatched
- Architectural Servicesunmatched
- Artificial Intelligence (AI)unmatched
- Automationunmatched
- Cloud Computingunmatched
- Cross-Functionalunmatched
- Debugging Skillsunmatched
- Ecosystemsunmatched
- Machine Learningunmatched
- Mentoringunmatched
- Open Sourceunmatched
- Performance Modelingunmatched
- Performance Tuning/Optimizationunmatched
- Process Improvementunmatched
- Product Engineeringunmatched
- Software Developmentunmatched
- Software Engineeringunmatched
- Systems Engineeringunmatched
- Systems Reliabilityunmatched
- Technical Leadershipunmatched
- Technical Strategyunmatched
- Technical Writingunmatched
- Technical/Engineering Designunmatched
- Usability Engineeringunmatched
- Writing Skillsunmatched
Description
We develop AWS Neuron, the complete software stack for Trainium, Amazon"s custom cloud-scale machine learning accelerators. Join us to optimize the latest models to run really fast on the Trainium hardware.
As a Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state-of-the-art open-source and customer LLMs, both dense and MoE, for inference on Trainium accelerators. You will also drive improvements in model enablement speed and experience, while advancing inference usability and quality through inference features, infrastructure optimization, tools, and automation.
Key job responsibilities
- Deliver high-performance models using distributed inference libraries
- Drive technical excellence in performance optimization and system reliability across the Neuron ecosystem
- Mentor team members and provide technical leadership across multiple work streams
- Drive architectural decisions that impact the entire Neuron serving stack
- Collaborate with customers, product owners, and engineering teams to define technical strategy
- Author technical documentation, design proposals, and architectural guidelines
A day in the life
You"ll lead critical technical initiatives while mentoring team members. You"ll collaborate with cross-functional teams of applied scientists, system engineers, and product managers to architect and deliver state-of-the-art inference capabilities. Your day might involve:
- Leading design reviews and architectural discussions
- Debugging complex performance issues across the stack in collaboration with the compiler and runtime teams
- Mentoring junior engineers on system design and model optimization across model enablement teams
- Driving technical decisions that shape the future of Neuron"s inference stack
About the team
The inference model enablement team releases its models in the vLLM Neuron plugin: https://github.com/vllm-project/vllm-neuron
Numbers & Facts
| Location | Cupertino, CA |
| Industry | Retail |
| Company Size | 10,000 employees or more |
| Year Founded | 1994 |
| Website | http://Amazon.com/militaryroles |
About Company
At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life.
Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.
It’s Always Day 1
At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here
Our Leadership Principles
Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles
Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.
It’s Always Day 1
At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here
Our Leadership Principles
Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles
Similar Jobs
- New!
AI Engineer Twenty80 LLC
San Mateo, CA5 days ago Senior Staff Engineer, AI Governance Visa Technology and Operations LLC
Foster City, CA12 days ago- $192,200–$307,700 Per Year
Mechanical Design Engineer - Commercial HVAC Jobot
Union City, CA7 days ago- $55–$75 Per Hour
- New!
Senior Principal Engineer- End-to-End AI Training Framework Bosch Group Inc
Sunnyvale, CA3 days ago- $240,000–$320,000 Per Year
Senior Engineer, Software Engineering Comrise
San Jose, CA7 days ago- $70–$75 Per Hour
- Full-time
- Employee