Software Development Engineer Test, Alexa Global quality

Come join us to launch Alexa+ globally to millions of customers across 100+ countries, solving hard challenges in multilingual, conversational CX evaluation across multimodal experiences spanning text, voice, and visual across many device surfaces. We are solving hard challenges in validation across speech, visual, conversational quality, locale cultural, and linguistic dimensions - building agentic automation tooling that spans the full quality spectrum from synthetic test generation, to LLM-as-a-Judge evaluation, to visual validation using AI, to cultural relevancy classification powered by machine learning.

The Alexa Global Quality (AGQ) team is responsible for ensuring Alexa delivers a high-quality, culturally relevant experience to customers across multiple international locales. We are building a scalable, AI-powered automation solution for multi-locale and linguistic product validation - one that can efficiently scale across all supported locales while maintaining the cultural and linguistic nuances that matter to our diverse customer base.

Key job responsibilities

• This role will lead the quality assurance automation and framework creation/enhancement efforts responsible for the end-to-end quality of Alexa"s multi-locale experience. We are looking for a proven, hands-on, results-oriented quality assurance software engineer to drive the strategy, tool selection, quality bar, and best practices for the future experience of our international customers.
• Establishing a consistent, scalable testing framework that supports multi-locale validation and complements the development processes across all supported locales
• Working closely with engineers to architect and develop the best technical design and testing approach for internationalization (i18n)
• Building and evolving agentic tooling for end-to-end quality evaluation - from synthetic test case generation, to multimodal response validation, to automated cultural and linguistic correctness assessment
• Creating metrics and reports on quality status, technical operations, and system performance across all locales, driving towards agreed-upon quality bars that are consistent yet culturally appropriate per market
• Working effectively with product managers, Country PMs, designers, engineering, locale experts, and business teams to deliver the best overall experience factoring in financial goals, usability goals, and locale-specific customer expectations