Senior Forward Deployed Engineer (Model Customization and Optimization)

As a Senior Forward Deployed Engineer (Senior FDE) on the Custom Model and Optimization team, you are the technical lead embedded inside a strategic customer, accountable for building, optimizing, and running the custom generative AI models at the heart of their business. You set the technical direction for model customization and optimization engagements, deciding what to build, how to measure it, and how it reaches production. You combine the technical depth of an AWS senior engineer with the urgency of a startup builder, using your judgment and ownership to deliver measurable business outcomes in quality, latency, and cost.

Senior FDEs work on the hardest problems where models meet systems: building domain foundation models, post-training frontier-scale open-weight models with reinforcement learning, and migrating large training and inference workloads onto AWS Trainium. They take on problems where the business problem itself is ambiguous, define the approach, and break it into workstreams others can own. They make long-term architectural trade-offs, balance customer urgency against sustainable design, and are trusted by customer engineering leadership as a technical peer. They raise the bar for the team through design reviews, code reviews, mentorship, and hiring, and they shape how AWS builds.

Key job responsibilities

Lead the technical engagement: Embed with the customer as the technical lead for their model customization and optimization program, spanning multiple workstreams. Partner with customer engineering and product leadership to frame the business problem, define success metrics and the evaluation bar, and set technical roadmap that moves from proof of value to production. Communicate trade-offs, risks, and results clearly to executives and engineers alike. Requires up to 25% travel.

Define the customization strategy: Decide the right path to the customer"s quality, latency, and cost targets - prompting, distillation, supervised fine-tuning, preference optimization, reinforcement learning (including RL with verifiable rewards and multi-turn agentic RL), continued pre-training, task-specific adapters, or building a domain foundation model. Own the data strategy, synthetic data generation, and evaluation methodology that make those decisions defensible, and drive them to production for patterns such as coding agents, vertical foundation models, and multi-adapter serving.

Architect training and inference systems at scale: Design distributed training and RL post-training systems for large dense and mixture-of-experts models using frameworks such as PyTorch FSDP2, Megatron-LM, Miles, and verl, and production inference architectures using engines such as SGLang and vLLM. Architect RL interaction harnesses using frameworks such as NeMo Gym and OpenEnv, defining how agent workflows, tools, environments, and reward functions connect to training and evaluation. Set parallelism, precision, and serving strategies that balance throughput, latency, memory, reliability, and cost per token, and ensure the designs hold up under production load.

Lead optimization on AWS AI chips: Lead migrations of training and inference workloads to AWS Trainium using the AWS Neuron SDK. Diagnose performance and accuracy-parity gaps against GPU baselines, direct kernel-level optimization where it matters, and work with AWS Neuron and service teams to close capability gaps. Turn benchmark evidence into recommendations that shape customer infrastructure and capacity decisions.

Lead, mentor, and raise the bar: Provide technical leadership to a team of FDEs and scientists on the engagement, breaking ambiguous problems into well-scoped workstreams and unblocking others. Mentor FDE IIs on model systems design and production ownership. Lead design reviews, provide high-judgment code review, and actively participate in hiring and interviewing.

Multiply impact across AWS: Identify patterns across engagements and turn them into reusable fine-tuning recipes, evaluation frameworks, benchmarking tools, and reference architectures adopted by other teams. Influence the roadmaps of AWS services, including Amazon Bedrock, Amazon SageMaker AI, and AWS Neuron, with field evidence. Identify and shape opportunities to expand model customization and optimization within your customer and across similar customers.

Oversee engagement execution: Own the delivery plan, set milestones, track progress against deadlines, and ensure the quality and completeness of all deliverables. Hold yourself and the team accountable for commitments made to the customer, escalate risks early, and adjust scope or resources when timelines are at risk.

About the team

ABOUT AWS:

Diverse Experiences

Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

Why AWS

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Work/Life Balance

We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

Inclusive Team Culture

AWS values curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower our people to take pride in what makes us unique. Our inclusion events foster stronger, more collaborative teams. Our continual innovation is fueled by the bold ideas, fresh perspectives, and passionate voices our teams bring to everything we do.

Mentorship and Career Growth

We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

Team

The Custom Models & Optimization team, part of the AWS Forward Deployed Engineering team, partners with enterprises, AI-native startups, and foundation model providers to build, customize, and optimize generative AI models at scale. Our work spans domain foundation models, post-training of open-weight models, and moving training and inference onto AWS Trainium. As embedded engineers within the AWS Forward Deployed Engineering motion, we bring deep model and optimization expertise to customers" most strategic AI workloads, and we turn what we learn into tooling and patterns that scale across AWS.

10047