Sign upLog in

AI Testing Analyst

Madison-Davis

New York, NY

Apply
JOB DETAILS
SALARY
$50
SKILLS
Acceptance Testing, Agile Programming Methodologies, Analysis Skills, Application Programming Interface (API), Artificial Intelligence (AI), Atlassian JIRA, Automation, Backlog Prioritization, Best Practices, Business Analysis, Business Solutions, Communication Skills, Cross-Functional, Documentation, Emerging Technology, Enterprise Applications, Financial Services, Functional Testing, Integration Testing, Mail Services, Microsoft Product Family, Model Validation, Modeling Languages, Multiplatform/Cross-Platform, Presentation/Verbal Skills, Problem Solving Skills, Quality Assurance, Quality Assurance Methodology, Regression Testing, Software Administration, Software Engineering, Software Testing, Sprint Planning, System Integration (SI), Technical Writing, Test Case, Test Plan/Schedule, Test Scripts, Testing, Validation Documentation, Writing Skills
LOCATION
New York, NY
POSTED
8 days ago

About the Opportunity:

A leading enterprise organization is expanding its Artificial Intelligence capabilities and is seeking an experienced AI Test Analyst / Technical Business Analyst to support the validation and implementation of next-generation AI solutions across enterprise platforms.

This role blends business analysis, functional testing, integration validation, and technical documentation. You'll work closely with product managers, software engineers, QA teams, and business stakeholders to ensure AI-powered features, APIs, and enterprise integrations perform as expected while helping establish scalable testing standards and best practices.

This opportunity is ideal for someone who enjoys working at the intersection of business analysis, software testing, and emerging AI technologies.

What You'll Tackle:
  • Validate enterprise AI integrations across business applications and internal platforms.
  • Perform functional, integration, regression, and user acceptance testing (UAT) for AI-powered solutions.
  • Develop comprehensive test plans, test cases, and test scripts based on business and technical requirements.
  • Execute API testing to validate enterprise integrations and system functionality.
  • Verify AI workflows, business logic, and application behavior across multiple environments.
  • Document testing results, defects, recommendations, and implementation findings.
  • Create operational runbooks, process documentation, and testing standards.
  • Gather, analyze, and document business and functional requirements.
  • Collaborate with software engineering teams throughout development, testing, and deployment activities.
  • Participate in Agile ceremonies, sprint planning, and backlog refinement.
  • Help establish repeatable AI testing methodologies and quality assurance best practices.
  • Support enterprise software integration initiatives and platform modernization efforts.

QUALIFICATIONS
  • Five or more years of experience as a Technical Business Analyst, QA Analyst, or Software Test Analyst.
  • Experience supporting enterprise software implementation or integration projects.
  • Strong functional and integration testing experience.
  • Experience developing test plans, test cases, and test scripts.
  • Experience validating APIs and enterprise system integrations.
  • Strong business analysis and requirements gathering skills.
  • Excellent technical documentation and process documentation abilities.
  • Experience working within Agile/Scrum software development environments.
  • Strong analytical and problem-solving skills.
  • Ability to work independently while collaborating across cross-functional teams.
  • Excellent verbal and written communication skills.
  • Hands-on experience testing AI or Generative AI solutions using platforms such as Microsoft Copilot, OpenAI, Gemini, Claude, or similar technologies.
  • Experience using Jira, Confluence, or comparable Agile collaboration tools.

PREFERRED EXPERIENCE
  • Experience supporting enterprise AI or Generative AI initiatives.
  • Experience validating Large Language Model (LLM) integrations.
  • API automation or Postman experience.
  • Experience testing cloud-based enterprise applications.
  • Knowledge of prompt engineering concepts.
  • Experience supporting infrastructure or platform modernization initiatives.
  • Financial services or other highly regulated industry experience.

About the Company

M

Madison-Davis

Resume Resources

Free Resume TemplatesFree Resume Builder