Senior Evaluation Automation Engineer

ECS Federal LLC

DC

JOB DETAILS
LOCATION
DC
POSTED
26 days ago

Everforth ECS is seeking a Senior Evaluation Automation Engineer to work in the National Capital Region covering the Pentagon, Falls Church, and Fairfax. Please Note: This position is contingent upon contract award.

The War Data Platform (WDP) is a key initiative within the U.S. Department of War's (DoW) AI-First strategy introduced in early 2026. The WDP focuses on operational warfighting data and aims to accelerate the deployment of artificial intelligence (AI) on the battlefield. The WDP extends to Unclassified, Secret, and Top Secret environments, and supports collaboration between Combatant Commands, Joint Staff directorates, Senior Executive Service leaders, and operational analysts.

This position leads the automation of evaluation and testing for AI/ML models in secured DoW environments.

  • Develops, builds, and maintains automated test and evaluation checks executed within unclassified-first deployment pipelines supporting artificial intelligence and machine learning model serving missions for DoW programs, Joint Staff analysts, Combatant Command elements, and Senior Executive Service leadership.
  • Designs and sustains automated unit, regression, and evaluation harness components that validate model artifacts across multiple enclaves and security domains.
  • Executes higher-domain parity test and evaluation gate checks and resolves enclave-specific constraints to preserve gate credibility across promoted releases.
  • Implements automated scanning, packaging, and deployment workflows using Kubernetes, GitLab Continuous Integration, PyTest, SonarQube, Tenable Nessus, and hardened artifact pipelines to validate reliability, operational suitability, and mission alignment of production-ready models.
  • Integrates evaluation harnesses into enterprise DevSecOps pipelines to support mission assurance objectives and operational readiness requirements.
  • Builds automated workflows supporting API endpoint configuration, proxy provisioning, and model zoo onboarding activities aligned with enterprise artificial intelligence model serving architectures.
  • Produces mission-critical deliverables including automated test suites, evaluation harness documentation, readiness scorecards, operational risk assessments, and deployment decision artifacts.
  • Collaborates with Platform One, Cloud One, multi-national engineering teams, and cross-service mission partners to advance automation maturity, strengthen deployment consistency, and reinforce program value commitments across all environments.
  • Supports Tier-4 incident response actions to maintain service-level agreements and operational continuity for mission stakeholders.
  • Performs other duties as assigned.

About the Company

E

ECS Federal LLC

ECS was founded in 2001 by experienced IT professionals with a commitment to quality processes, people and performance. Led by our Chairman, Roy Kapani, and an experienced executive leadership team, ECS provides our customers with solutions and services that support their critical needs and further mission objectives. This commitment has paved the way for expansive growth, year over year.

ECS gained market share in 2011 in the Department of Defense and Federal spaces through both organic and acquisition growth. In May, ECS completed its first strategic acquisition with the purchase of OAK Management, Inc., a leading provider of marine environmental services, ship systems engineering, maritime consulting and platform acquisition management. The OAK acquisition kicked off ECS’ intention to add tactical acquisitions as a part of its long term strategy to supplement and expand upon organic growth and to build enterprise value. ECS closed out 2011 with the acquisition of Paradigm Technologies, Inc. The Paradigm transaction added approximately 200 employees to ECS’ existing 900+ employees. Paradigm also added new Defense clients for ECS, including the Missile Defense Agency, the Navy’s Program Executive Officer for Integrated Warfare Systems, the United States Marine Corps, and the U.S. Marshals Service.

In 2012, ECS completed the acquisition of iLuMinA Solutions, Inc. iLuMinA brings large-scale Enterprise Resource Planning (ERP) software implementation and infrastructure design and development to ECS’ expanding capabilities.

ECS will continue to invest in corporate infrastructure and quality processes as we grow and enhance our ability to offer professional excellence to both our customers and our employees.

COMPANY SIZE
50 to 99 employees
INDUSTRY
Staffing/Employment Agencies
FOUNDED
2000
WEBSITE
http://www.ecs-federal.com/