AI Agent Developer & Tester
Location: Salt Lake City, Utah
Contract Rate: $80-$100 per hr
8-month contract
Job Description:
Our client is seeking an AI/Agent Developer & Tester to support the development, testing, and deployment of AI agent workflows within their platform. This role will be responsible for building and validating LangGraph-based agents, developing automated test coverage, and ensuring reliability across development and production environments.
The ideal candidate will have strong experience with Python, LangGraph, and modern testing frameworks. Responsibilities include creating node-level unit tests, graph-level integration tests, regression testing, and production monitoring for AI-powered applications. This individual will also manage end-to-end UI testing using Playwright and support cloud-based infrastructure that powers the AI platform.
This role requires a quality-focused engineer who can work independently, build scalable testing practices, and help deliver stable, production-ready AI solutions.
Required Skills:
• Experience with LangGraph and LangChain
• Strong Python development experience
• Experience with pytest and pytest-asyncio
• Experience building unit tests for AI agents and workflow nodes
• Experience creating end-to-end agent and graph integration tests
• Knowledge of LLM mocking and test isolation strategies
• Experience managing non-deterministic AI behavior through controlled testing methods
• Experience designing and maintaining regression test suites
• Playwright end-to-end testing experience
• Test coverage reporting and analysis experience
• Experience with JSON schema validation and structured outputs
• Production monitoring and observability experience
• Cloud application development and support experience (GCP preferred)
• Strong troubleshooting and problem-solving skills
Bonus/Soft Skills:
• Experience with LangSmith or RAGAS
• Prompt versioning experience
• Adversarial or red-team testing experience
• Token usage and cost monitoring experience
• Experience with document extraction or OCR workflows
• Experience in financial services or other regulated industries
• Experience with GCP and Cloud Run
• Terraform experience
• Azure DevOps pipeline experience
• Strong communication and collaboration skills
Welcome to ConsultNet, a premier national provider of technology talent and solutions. Our expertise spans across project services, contract-to-hire, direct search, and managed services onshore, nearshore, and hybrid. For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. Our comprehensive service offerings cover a wide range of technology and engineering positions across key markets nationwide. Learn more at www.consultnet.com .
We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.