Senior Software Engineer (AI Systems & Infrastructure)

Description: 

We are seeking a highly experienced and driven Sr. Software Engineer to join a full stack LLM integration and delivery team. Ideally, you'll have a strong background in building scalable AI-powered applications and the infrastructure that supports them, with a focus on delivering exceptional user experiences. You will play a crucial role in architecting and developing the systems that power cutting-edge LLM applications, ensuring they perform reliably at enterprise scale while enabling rapid iteration and deployment.

The ideal candidate will have the grit, self-reliance, and drive to identify and fix inefficiencies, consistently leaving our codebase and infrastructure in a better state than they found it. We're looking for someone who thrives in a fast-paced environment, gets excited about seeing their code improve real user workflows, and is passionate about building and maintaining robust, scalable systems that power cutting-edge LLM applications. You should be someone who actively questions requirements, wants to learn, and brings the industrious mindset that ensures our tools not only work but truly serve our users' needs.

Salary range: $235,000-255,000
Disclaimer: Salary for this position, along with additional compensation options, will be determined on an individual basis following the interview process, considering various factors such as years of experience, skills, education/certifications, contract specifications, market conditions, etc. 
 

Responsibilities:

• Lead the design and development of scalable LLM-powered applications and services.
• Architect infrastructure solutions that support rapid iteration and deployment of AI features
• Collaborate directly with product teams to translate user needs into technical solutions.
• Build and maintain the platforms that enable your team to ship AI features quickly and reliably.
• Develop and manage automation tools to improve system reliability and development efficiency.
• Implement and maintain monitoring, alerting, and logging systems.
• Conduct capacity planning and performance tuning for AI workloads.
• Lead and participate in incident response and post-mortem analyses.
• Mentor junior team members and contribute to the overall growth of the engineering team.
• Continuously identify and implement improvements to our systems and development

Skills Requirements:

• 12+ years of experience in software engineering with focus on scalable systems.
• Strong full-stack development experience with user-facing applications.
• Strong programming skills in languages such as Python, Go, or Java.
• Extensive experience with cloud platforms (e.g., AWS, GCP, Azure) and their services.
• Proficiency in containerization technologies (Docker, Kubernetes).
• Experience with infrastructure-as-code tools (e.g., Terraform, Ansible, Puppet).
• Expertise in monitoring and observability tools (e.g., Prometheus, Grafana, ELK stack).
• Familiarity with CI/CD pipelines and practices.
• Strong problem-solving skills and ability to troubleshoot complex systems.
• Excellent communication skills and ability to work in a collaborative environment.
• Experience building products that prioritize user experience and product-market fit.

Nice to Haves:

• Experience working with Large Language Models (LLMs) and related infrastructure.
• Experience with AI/ML model serving and optimization.
• Background in product-focused engineering environments.
• Familiarity with machine learning operations (MLOps) practices.
• Experience with A/B testing and feature flagging for AI features.
• Contributions to open-source projects.
• Experience with distributed systems and microservices architectures.
• Knowledge of security best practices and compliance requirements.
• Experience with real-time data processing and streaming platforms (e.g., Apache Kafka, Apache Flink).
• Familiarity with chaos engineering principles and tools.

Experience Requirement: 

• 12 yrs. with a B.S. in a technical discipline or 4 additional yrs. in place of B.S.

Clearance Requirement: 

• Active TS/SCI with a polygraph

Referrals & Inquiries

Do you know a cleared professional seeking to advance their career? Interested in earning some extra cash? If so, refer them to us with their name and contact details, and you could be eligible for a referral bonus of up to $10,000 for each successful hire.

Not seeing the right position right now? Reach out to us, and we’ll notify you as new contracts and opportunities become available!