Sr. SDET

Senior QA Automation Engineer– AI-Enabled Testing

Overview

We are looking for a hands-on QA Automation Engineer/SDET with strong experience in traditional software testing and ideally AI/LLM-powered applications. This person should be skilled in manual and automated testing, API/UI automation, and CI/CD, with experience testing AI agents, multi-turn conversations, and LLM outputs.

This is not an AI research role. We need a strong QA Automation Engineer who can apply AI and modern automation practices to improve software quality, test coverage, and testing efficiency.

Responsibilities

• Design and execute manual and automated tests for UI, API, integration, end-to-end, and regression testing.
• Test AI agents, multi-turn conversations, LLM outputs, and agentic workflows.
• Build evaluation frameworks and regression suites to measure LLM quality, reliability, and consistency.
• Automate API and UI testing using Python, JavaScript/TypeScript, pytest, Playwright, Cypress, or Selenium.
• Develop test strategies using BDD, TDD, and ATDD methodologies.
• Integrate automation into CI/CD pipelines.
• Identify coverage gaps, edge cases, and opportunities to improve automation.
• Use Jira and test management tools to manage test cases, defects, and quality metrics.
• Collaborate with Engineering, Product, and QA teams to drive quality improvements.

Required Skills

• Strong experience in manual and automated QA testing.
• Programming experience in Python, JavaScript, or TypeScript.
• Experience with pytest, Playwright, Cypress, or Selenium.
• Strong API and UI automation experience.
• Experience testing LLM-powered applications, AI agents, or agentic workflows.
• Experience designing tests for multi-turn conversations and non-deterministic AI outputs.
• Experience with LLM evaluation frameworks and regression testing.
• Knowledge of BDD, TDD, ATDD, and Agile methodologies.
• Experience with CI/CD, Jira/test management, SQL/NoSQL, and related QA tools.
• Demonstrated hands-on use of AI/GenAI tools for testing and automation.