Job Description
Job Title: Test Automation Engineer – Python + GenAI + LLMs
Location: Phoenix, AZ – Day 1 Onsite / Hybrid
Experience: 5+ Years
Employment Type: Full-Time
Onsite Requirement: Candidates must be willing to work onsite in Phoenix from Day 1.
JOB DESCRIPTION
We are seeking an experienced Test Automation Engineer with strong hands-on expertise in Python, Generative AI (GenAI), Large Language Models (LLMs), Playwright, and MCP (Model Context Protocol).
The ideal candidate will have a strong background in test automation and practical experience applying AI and LLM technologies to modern software testing. Python-only automation experience is not sufficient for this position. Hands-on GenAI and LLM experience is mandatory.
Job Responsibilities
KEY RESPONSIBILITIES
· Design, develop, and maintain scalable test automation frameworks using Python, Playwright, and MCP.
· Integrate and validate LLM and GenAI technologies within test automation workflows.
· Develop AI-assisted solutions for test case generation, test data generation, and automation improvements.
· Implement BDD testing approaches using Cucumber/Gherkin where applicable.
· Develop and execute automated UI, API, and end-to-end test scenarios.
· Execute and manage automated test suites using TestNG and TestX.
· Analyze test results and troubleshoot automation failures.
· Identify root causes and provide recommendations for improving application quality.
· Log, track, and support resolution of software defects.
· Collaborate with developers, QA engineers, product teams, and other stakeholders in an Agile environment.
· Identify opportunities to improve test coverage, automation efficiency, and overall software quality.
· Support AI-driven and next-generation quality engineering initiatives.
Numbers & Facts
| Location | Phoenix, AZ |
| Job Type | Contractor, Full-time |
| Salary | $70,000–$75,000 Per Year |
| Company Size | 201 - 500 |
| Headquarters | Livonia, MI, US |
| Website | https://plugins-inc.com/ |
Qualifications
REQUIRED SKILLS AND QUALIFICATIONS
· 5+ years of experience in software testing and test automation.
· Strong hands-on experience with Python.
· Hands-on experience with Generative AI (GenAI).
· Strong knowledge and practical experience with Large Language Models (LLMs).
· Experience with LLM prompting, RAG, AI-assisted test generation, or related GenAI applications.
· Hands-on experience with Playwright for UI and/or API automation.
· Knowledge or hands-on experience with MCP (Model Context Protocol).
· Experience with BDD frameworks such as Cucumber and Gherkin.
· Experience with TestNG.
· Experience with TestX.
· Working knowledge of Java.
· Strong understanding of software testing methodologies and automation best practices.
MUST-HAVE SKILLS
Python | GenAI | LLMs | Playwright | MCP | BDD | TestNG | TestX | Java
IMPORTANT:
· Candidates must have meaningful experience with both GenAI and LLM technologies in addition to Python-based test automation.
· Candidates with Python automation experience alone will not be considered.
GOOD TO HAVE
· Experience with AI-driven testing tools and quality engineering solutions.
· Experience with CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.
· Experience with Docker.
· Experience with AWS or Azure cloud platforms.
· Experience working in Agile/Scrum environments.
Skills
- Artificial Intelligence (AI)unmatched
- Automation Engineeringunmatched
- MCP - Microsoft Certified Professionalunmatched
- Modeling Languagesunmatched
- Python Programming/Scripting Languageunmatched
- Software Testingunmatched
- Test Automationunmatched
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesFree resume builder
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder