Test Engineer III

Reflexive Concepts is seeking a skilled Test Engineer III to join our team!

Responsibilities

• Develop, maintain, and enhance automated test suites for back-end REST APIs and web-based user interfaces.
• Build and maintain a scalable, reliable test automation harness (framework) including execution, reporting, data setup/teardown, and CI/CD integration.
• Implement and expand Python-based test automation using Pytest, including fixtures, test data strategies, and robust assertions/validation.
• Create and maintain Docker/Podman container images used to run automation consistently across developer environments and CI pipelines.
• Integrate automated test execution into Jenkins and GitLab CI/CD pipelines, ensuring repeatable runs, clear reporting, and actionable results.
• Use Linux command-line tools and Bash shell scripting to locate, parse, transform, and report on large volumes of logs, test output, and system data.
• Support and extend UI automation using Robot Framework and the Python Selenium library, including test stability improvements and best practices.
• Collaborate with stakeholders to plan, estimate, and break down work for migrating the current in-house test harness from legacy Robot Framework to a modern alternative (e.g., Robot Framework AIO or Microsoft Playwright).
• Write and maintain SQL queries (using SQL Developer or similar tooling) and integrate database validation steps into automated tests where appropriate.
• Troubleshoot CI failures and test irregularity/volatility, improve test reliability, and contribute to continuous improvement of the overall QA automation approach.

Qualifications

• Eight (8) years' experience as a TE in programs and contracts of similar scope, type, and complexity is required.
• Bachelor's degree in Math, Science, Engineering, Statistics, Engineering Management, or related discipline from an accredited college or university is required.
  • Four (4) years of additional TE experience may be substituted for a bachelor's degree.
• Strong experience with Linux and Bash shell scripting, with demonstrated ability to work effectively from the command-line and process/report on large data sets (logs, test artifacts, results).
• Advanced experience building test automation in Python, including Pytest-based frameworks and best practices for maintainable automated testing.
• Strong hands-on experience with Docker (or Podman) including building, versioning, and maintaining images used in automation and CI/CD workflows.
• Working knowledge of Jenkins and GitLab pipelines, including running containerized workloads and managing automated test stages.
• Experience with REST API testing, including validation of responses, authentication flows, and negative/error-path testing.
• Familiarity with Robot Framework UI automation using Selenium library (Python).
• Solid understanding of how to architect a test automation harness/framework for UI and/or API testing (test structure, configuration, reporting, environment management).
• Familiarity with SQL and tools such as SQL Developer, including writing queries and using them within automated validation steps.

Required

• Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results.
• Supports the development of Government test and evaluation documentation, e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports.
• Works with other test organizations to support T&E program integration.
• Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance area as assigned in the SOW.

Desired Skills

• Experience planning and executing test automation framework migrations (e.g., Robot Framework to Microsoft Playwright or Robot Framework AIO).
• Experience improving CI performance, parallelization, and test execution efficiency in containerized environments.
• Strong debugging skills across services, CI logs, containers, and test reporting outputs.