Amazon.com Inc logo

Senior Applied Scientist, Real-Time Conversational AI , AGI

Amazon.com Inc

  • Sunnyvale, CA
  • 8 days ago
    Want to know if you’re a fit?
    Upload your resume and let our AI show you.

    Skills

    • Architectural Designunmatched
    • Artificial Intelligence (AI)unmatched
    • Budgetingunmatched
    • Data Modelingunmatched
    • Design Evaluationunmatched
    • Develop Methodologiesunmatched
    • Hardware Architectureunmatched
    • Input/Outputunmatched
    • Process Modelingunmatched
    • Reinforcement Learningunmatched
    • Research & Development (R&D)unmatched
    • Training/Teachingunmatched
    • Voice Applicationsunmatched

    Description

    We are looking for a Senior Applied Scientist to help drive the research and development of real-time multimodal conversational AI. You will contribute across two focus areas: advancing foundation models for speech and audio, and building the post-training systems (reward modeling, reinforcement learning) that shape natural, human-like conversational behavior.

    You will own a significant research area and contribute across the full model lifecycle - from pre-training and architecture design through post-training alignment and real-time deployment. You will work at the frontier of what's possible in conversational AI, with the compute, data, and runway to pursue problems that few teams in the world have the resources to tackle.

    As a Senior Scientist, you will drive the technical execution of your research area, contribute to the team's roadmap, and work closely with inference engineers to ensure your models are designed for real-time production deployment.

    Key job responsibilities

    What You'll Do

    Foundation Model Scaling

    • Help build and train large-scale multimodal foundation models for real-time speech and audio generation, from architecture design through production-scale training
    • Advance the scaling and efficiency of conversational models, including the relationship between data, model size, and real-time performance
    • Design model architectures informed by hardware constraints and inference requirements, working with inference engineers to ensure models are servable from inception
    • Develop training methodologies for multimodal models that jointly process and generate speech, language, and audio in real-time streaming contexts
    • Contribute to the state of the art on efficient architectures and training methods for conversational AI at scale

    Post-Training & Reinforcement Learning

    • Design and build reward models and reward functions for speech systems - capturing naturalness, fluency, conversational quality, and real-time responsiveness
    • Develop and apply reinforcement learning methods to shape conversational behavior - teaching models natural timing, responsiveness, and fluid interaction
    • Build parts of the post-training pipeline from SFT through RL alignment, optimized for real-time multimodal outputs rather than text-only generation
    • Design evaluation frameworks that capture the quality dimensions unique to real-time conversation (latency sensitivity, audio quality, prosody, interaction naturalness)

    Real-Time Perception & Generation

    • Advance the team's capabilities in real-time perception - the ability of the model to process incoming audio/speech while simultaneously generating responses
    • Develop techniques for natural interactive systems where the model handles concurrent input and output with human-like timing
    • Work at the intersection of model architecture and production constraints to ensure multimodal capabilities function within hard real-time latency budgets

    Numbers & Facts

    LocationSunnyvale, CA
    IndustryRetail
    Company Size10,000 employees or more
    Year Founded1994
    Websitehttp://Amazon.com/militaryroles

    About Company

    At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life.

    Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.

    It’s Always Day 1
    At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here

    Our Leadership Principles
    Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles

    Similar Jobs

    See more jobs