AI Testing Analyst

Madison-Davis
  • New York, NY
  • $50
  • Quick Apply
30+ days ago

Job Description


About the Opportunity:

A leading enterprise organization is expanding its Artificial Intelligence capabilities and is seeking an experienced AI Test Analyst / Technical Business Analyst to support the validation and implementation of next-generation AI solutions across enterprise platforms.

This role blends business analysis, functional testing, integration validation, and technical documentation. You'll work closely with product managers, software engineers, QA teams, and business stakeholders to ensure AI-powered features, APIs, and enterprise integrations perform as expected while helping establish scalable testing standards and best practices.

This opportunity is ideal for someone who enjoys working at the intersection of business analysis, software testing, and emerging AI technologies.

What You'll Tackle:
  • Validate enterprise AI integrations across business applications and internal platforms.
  • Perform functional, integration, regression, and user acceptance testing (UAT) for AI-powered solutions.
  • Develop comprehensive test plans, test cases, and test scripts based on business and technical requirements.
  • Execute API testing to validate enterprise integrations and system functionality.
  • Verify AI workflows, business logic, and application behavior across multiple environments.
  • Document testing results, defects, recommendations, and implementation findings.
  • Create operational runbooks, process documentation, and testing standards.
  • Gather, analyze, and document business and functional requirements.
  • Collaborate with software engineering teams throughout development, testing, and deployment activities.
  • Participate in Agile ceremonies, sprint planning, and backlog refinement.
  • Help establish repeatable AI testing methodologies and quality assurance best practices.
  • Support enterprise software integration initiatives and platform modernization efforts.

QUALIFICATIONS
  • Five or more years of experience as a Technical Business Analyst, QA Analyst, or Software Test Analyst.
  • Experience supporting enterprise software implementation or integration projects.
  • Strong functional and integration testing experience.
  • Experience developing test plans, test cases, and test scripts.
  • Experience validating APIs and enterprise system integrations.
  • Strong business analysis and requirements gathering skills.
  • Excellent technical documentation and process documentation abilities.
  • Experience working within Agile/Scrum software development environments.
  • Strong analytical and problem-solving skills.
  • Ability to work independently while collaborating across cross-functional teams.
  • Excellent verbal and written communication skills.
  • Hands-on experience testing AI or Generative AI solutions using platforms such as Microsoft Copilot, OpenAI, Gemini, Claude, or similar technologies.
  • Experience using Jira, Confluence, or comparable Agile collaboration tools.

PREFERRED EXPERIENCE
  • Experience supporting enterprise AI or Generative AI initiatives.
  • Experience validating Large Language Model (LLM) integrations.
  • API automation or Postman experience.
  • Experience testing cloud-based enterprise applications.
  • Knowledge of prompt engineering concepts.
  • Experience supporting infrastructure or platform modernization initiatives.
  • Financial services or other highly regulated industry experience.

Numbers & Facts

LocationNew York, NY
Salary$50

Skills

  • Acceptance Testingunmatched
  • Agile Programming Methodologiesunmatched
  • Analysis Skillsunmatched
  • Application Programming Interface (API)unmatched
  • Artificial Intelligence (AI)unmatched
  • Atlassian JIRAunmatched
  • Automationunmatched
  • Backlog Prioritizationunmatched
  • Best Practicesunmatched
  • Business Analysisunmatched
  • Business Solutionsunmatched
  • Communication Skillsunmatched
  • Cross-Functionalunmatched
  • Documentationunmatched
  • Emerging Technologyunmatched
  • Enterprise Applicationsunmatched
  • Financial Servicesunmatched
  • Functional Testingunmatched
  • Integration Testingunmatched
  • Mail Servicesunmatched
  • Microsoft Product Familyunmatched
  • Model Validationunmatched
  • Modeling Languagesunmatched
  • Multiplatform/Cross-Platformunmatched
  • Presentation/Verbal Skillsunmatched
  • Problem Solving Skillsunmatched
  • Quality Assuranceunmatched
  • Quality Assurance Methodologyunmatched
  • Regression Testingunmatched
  • Software Administrationunmatched
  • Software Engineeringunmatched
  • Software Testingunmatched
  • Sprint Planningunmatched
  • System Integration (SI)unmatched
  • Technical Writingunmatched
  • Test Caseunmatched
  • Test Plan/Scheduleunmatched
  • Test Scriptsunmatched
  • Testingunmatched
  • Validation Documentationunmatched
  • Writing Skillsunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder