Job Description
Our client is a leading financial institution investing in modern AI infrastructure and enterprise technology. They are seeking an experienced AI Senior Software Engineer to lead the design, implementation, and deployment of an enterprise-grade AI Gateway solution within a secure cloud environment.
Please note: No C2C, Subcontracting or Visa Sponsorship of any kind is available for this position.
The engagement will include implementation, automation, documentation, knowledge transfer, and support through the initial production rollout.
This is 100% remote position within the US.
Responsibilities:
- Design and implement a secure, scalable AI Gateway infrastructure using Infrastructure as Code (IaC)
- Configure and customize the AI Gateway to align with enterprise security, governance, and operational requirements
- Deploy and integrate the solution within a cloud-based environment
- Develop automation to support repeatable, reliable, and maintainable deployments
- Integrate the gateway with AI/ML services, APIs, and supporting cloud infrastructure
- Implement appropriate controls for authentication, authorization, access management, rate limiting, and usage management
- Conduct comprehensive functional, integration, performance, and reliability testing
- Ensure the solution meets enterprise requirements for security, scalability, availability, and operational resilience
- Establish monitoring, logging, and observability capabilities for the deployed platform
- Support the initial production deployment and rollout
- Troubleshoot and resolve technical issues during the launch and early adoption period
- Optimize the platform based on initial usage and operational feedback
- Create comprehensive technical documentation covering architecture, configuration, deployment, and ongoing operations
- Develop onboarding materials, operational runbooks, and deployment procedures
- Provide architecture diagrams and other supporting technical documentation
- Conduct knowledge-transfer sessions with internal engineering and operations teams
- Deliver a complete, maintainable IaC codebase using appropriate version-control practices
- Provide post-implementation support through the initial production rollout
Requirements:
- Strong hands-on experience with AWS services and cloud architecture
- Proven experience designing and implementing cloud-based infrastructure solutions
- Strong proficiency with Infrastructure as Code tools such as Terraform, CloudFormation, CDK, or similar
- Hands-on experience with an AI Gateway, LLM Gateway, API Gateway, or comparable platform; experience with LiteLLM is highly desirable
- Experience with API management, API gateways, and enterprise integration patterns
- Experience deploying and operating production-grade cloud infrastructure
- Strong understanding of cloud security, networking, identity and access management, and enterprise security practices
- Experience with CI/CD pipelines, automation, and modern DevOps practices
- Experience with monitoring, logging, and observability platforms such as CloudWatch, Grafana, or similar
- Understanding of AI/ML infrastructure, LLM services, or model deployment and management
- Knowledge of rate limiting, token management, usage tracking, and API cost optimization
- Ability to troubleshoot complex infrastructure and integration issues independently
- Strong technical documentation and communication skills
- Ability to work effectively with engineering, architecture, security, and operations stakeholders
- Experience with AWS security or cloud security certifications is highly desired
- Experience implementing AI/LLM platforms within highly regulated industries would be a plus
- Familiarity with enterprise AI governance, security, or compliance requirements is preferred
- Experience with LLM routing, model selection, fallback strategies, or provider abstraction would be advantageous
- Experience implementing centralized AI usage monitoring and cost controls would be beneficial
- Experience supporting production AI platforms through initial rollout and adoption would be a plus
#INDIT
Numbers & Facts
| Location | Boston, MA (Remote) |
| Industry | Staffing/Employment Agencies |
| Salary | $105 |
| Company Size | 20 to 49 employees |
| Year Founded | 1992 |
| Website | http://thepanthergrp.com |
About Company
The Panther Group is minority owned and certified, making diversity, equity and inclusion core components of our mission.
With our commitment to respecting and empowering our employees as individuals, diversity is a competitive advantage in the marketplace.
The Panther Group has a proven track record of connecting quality talent with the right position. We believe in a hands-on approach, with a focus on building lasting relationships with our Employees and our Clients. Our Employees find flexibility and growth to reach their career goals.
The Panther Group celebrates 25 years of recruitment and workforce solutions expertise.
Skills
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesFree resume builder
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder