Title: Software Engineer I
Location: Remote (United States)
Schedule: Full-Time, 40 hours/week
Type: 12-Month Contract with Possible Extension
Compensation: $75/hr
Benefits: PTO, Medical, Dental, Vision, 401(k), Life Insurance, Disability Coverage
About the Role:We are seeking a Software Engineer to help build and evaluate advanced AI systems that interact with software and complete complex computer-based tasks. This role combines software engineering, AI/ML evaluation, testing, and infrastructure development.
The ideal candidate is passionate about coding, has strong Python development experience, and enjoys solving complex technical challenges. You will work on designing evaluation frameworks, debugging large-scale systems, developing automated testing solutions, and helping improve the performance of next-generation AI technologies.
This is an excellent opportunity for engineers who enjoy building high-quality software, creating testing frameworks, and working at the intersection of software engineering and artificial intelligence.
Main Responsibilities:
- Design, develop, and maintain software solutions used to evaluate AI model performance.
- Build and maintain automated test frameworks, benchmarks, and evaluation pipelines.
- Create reproducible experiments and analyze results to identify system improvements.
- Debug issues across applications, infrastructure, configurations, and system integrations.
- Write high-quality, well-tested code with a strong focus on software reliability and maintainability.
- Support deployment strategies, validation processes, and risk management practices.
- Collaborate with engineering, product, and research teams to improve AI system performance.
- Document technical processes, findings, and implementation details.
Education and Experience Required: - Bachelor's Degree in Computer Science, Software Engineering, Mathematics, Engineering, or a related field.
- Minimum 2 years of professional Python development experience.
- Strong software engineering background with experience building production-quality applications.
- Experience working with AI/ML systems, model evaluation, or machine learning development.
- Experience creating automated tests, validation frameworks, or benchmarking solutions.
Required Skills and Qualifications: - Python development experience (minimum 2 years required)
- PyTorch (Torch)
- Software engineering fundamentals
- Automated testing and test-driven development
- Debugging and troubleshooting complex systems
- Machine Learning and AI model evaluation
- Benchmarking and performance analysis
- Experiment design and validation
- Risk management and software quality practices
- Experience using AI coding assistants such as:
- Claude Code
- Cursor
- Codex
- GitHub Copilot
- Strong written and verbal communication skills
Preferred Skills and Qualifications: - Rust
- TypeScript
- Distributed Systems
- Platform Engineering
- Infrastructure Engineering
- Developer Tooling
- MLOps
- Large-Scale Testing Frameworks
- Backend Systems Development
- Evaluation Pipelines
- AI Agents / Agentic AI
- Generative AI / Large Language Models (LLMs)
- Open-source project contributions
#LI-HA1