AI Quality & Validation Specialist

PingWind

  • Annandale, Virginia
  • 30+ days ago
    Want to know if you’re a fit?
    Upload your resume and let our AI show you.

    Skills

    • Acceptance Testingunmatched
    • Agile Programming Methodologiesunmatched
    • Artificial Intelligence (AI)unmatched
    • Audiovisualunmatched
    • Bug Tracking Softwareunmatched
    • Bug Tracking/Defect Managementunmatched
    • CASE (Computer-Aided Software Engineering)unmatched
    • Case Managementunmatched
    • Communication Skillsunmatched
    • Continuous Improvementunmatched
    • Detail Orientedunmatched
    • Documentationunmatched
    • Federal Contractsunmatched
    • Federal Governmentunmatched
    • Functional Testingunmatched
    • Healthcare Softwareunmatched
    • Identify Issuesunmatched
    • Information Technology & Information Systemsunmatched
    • Internet Applicationunmatched
    • Internet Securityunmatched
    • Leadershipunmatched
    • Multitaskingunmatched
    • Network Debuggingunmatched
    • Performance Managementunmatched
    • Presentation/Verbal Skillsunmatched
    • Procedure Developmentunmatched
    • Process Improvementunmatched
    • Professional Servicesunmatched
    • Quality Managementunmatched
    • Quality Metricsunmatched
    • Regression Testingunmatched
    • Service Deliveryunmatched
    • Software Administrationunmatched
    • Software Testingunmatched
    • Software Validationunmatched
    • Supply Chain Managementunmatched
    • Support Documentationunmatched
    • Team Playerunmatched
    • Technical Supportunmatched
    • Test Caseunmatched
    • Test Scenariounmatched
    • Testingunmatched
    • Validation Testingunmatched
    • Writing Skillsunmatched

    Description

    Location: HybridRequired Clearance: NoneRequired Education: Associate’s / Bachelor’s DegreeRequired Experience: 1–3 years of relevant experience in software testing, quality assurance, AI evaluation, content review, or related technical support
    Position Description
    PingWind is seeking an AI Quality & Validation Specialist to support the testing, validation, and continuous improvement of applications and AI-enabled solutions prior to release. This junior-level role is ideal for a detail-oriented professional who can evaluate system behavior, identify defects or quality issues, and provide structured feedback to improve application performance and AI-driven outputs.The AI Quality & Validation Specialist will help validate software functionality, assess the quality and relevance of AI-generated results, document findings, and support scenario-based testing from the end-user perspective. This role works closely with technical teams, product stakeholders, and project leads to help ensure released capabilities meet functional requirements and quality standards.
    Responsibilities
    •    Support functional, regression, and user-focused testing of applications and AI-enabled features before releaseEvaluate AI-generated outputs for quality, relevance, accuracy, consistency, and alignment to prompts, instructions, or reference materials
    •    Identify, document, and track software defects, content issues, edge cases, and output anomaliesPerform scenario-based testing by interacting with systems as an end user to validate workflows and expected outcomes
    •    Flag issues in AI or application behavior and provide clear written feedback on what should be corrected or improvedAssist with validation of prompts, workflows, procedures, and output-review criteria used in AI-supported processes
    •    Help review text, image, audio, video, or other generated outputs, as applicable to the programMaintain test evidence, validation notes, issue logs, and supporting documentation in accordance with project standards
    •    Collaborate with developers, analysts, engineers, and project leadership to clarify expected behavior and support issue resolutionParticipate in pilot testing of new features, experimental capabilities, and process improvements
    •    Support continuous quality improvement efforts by identifying recurring issues, trends, and opportunities for better testing coverageContribute to the development of repeatable validation procedures, checklists, and quality review practices
    Required Qualifications
    •    1–3 years of relevant experience in software testing, QA support, AI output evaluation, digital content review, or an Associate’s / Bachelor’s Degree in a related fieldStrong attention to detail with the ability to identify inconsistencies, defects, or quality issues
    •    Experience documenting findings clearly and communicating actionable feedbackAbility to follow structured instructions, evaluation criteria, and testing procedures
    •    Strong written and verbal communication skillsComfortable working across multiple tasks in a fast-paced environment
    •    Ability to think from the end-user perspective and test systems against expected outcomesBasic familiarity with modern software applications, web-based systems, and common collaboration/documentation toolsDesired Qualifications
    •    Experience evaluating generative AI outputs such as text, images, audio, or videoExperience supporting software QA, test execution, UAT, or validation activities
    •    Familiarity with defect tracking tools, test case management, or Agile delivery environmentsExperience comparing outputs against prompts, business rules, or reference materials
    •    Exposure to prompt testing, AI workflow review, or human-in-the-loop evaluation processesExperience in a federal contracting environment
    •    Active clearance or eligibility to obtain required clearance, if applicable
    About PingWind
    PingWind is focused on delivering outstanding services to the federal government. We have extensive experience in the fields of cybersecurity, development, IT infrastructure, supply chain management and other professional services such as system design and continuous improvement. PingWind is an SBA certified Service-Disabled Veteran-Owned Small Business (SDVOSB) with offices in Northern Virginia and Huntsville AL. www.PingWind.com
    Our benefits include
    Eleven Federal Holidays
    •    Paid Time Off accrued each pay periodParental Leave
    •    Three medical plan choices with generous employer contributionDental and Vision Insurance
    •    Company paid Short-Term and Long-Term DisabilityCompany paid Life and AD&D Insurance
    •    401k with competitive matching and vesting scheduleContinuing education assistance
    •    Medical, Dependent Care and Commuter Flexible Spending AccountsEmployee Assistance Program
    •    Wellness benefits include Calm Health app and WellHub gym subsidy529 College Savings Plan
    •    Legal InsurancePet Insurance
    Veterans are encouraged to apply.
    PingWind, Inc. does not discriminate in employment opportunities, terms, and conditions of employment, or practices on the basis of race, age, gender, religious or political beliefs, national origin or heritage, disability, sexual orientation, or any characteristic protected by law.
    We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
    We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

    Numbers & Facts

    LocationAnnandale, Virginia

    Similar Jobs

    See more jobs