We're looking for a Cloud Infrastructure Engineer who thrives on building and scaling large-scale GPU compute platforms fast. You'll be instrumental in developing and managing the foundational infrastructure that powers our AI workloads. Our core infrastructure relies heavily on Python, Kubernetes (K8s), Terraform, and Ansible, but we care more about your ability to learn, adapt, and ship robust solutions than whether you've used these exact tools before.
You are a good fit if this describes you:
You excel at building and managing distributed compute platforms, especially those involving GPU resources.
You have deep expertise in backend systems that orchestrate complex workloads efficiently, managing capacity and resource constraints.
You possess a strong understanding of foundational cloud infrastructure (AWS/GCP/Azure) and Linux provisioning/management tools.
You know how to design for reliability and scale with minimal operational overhead.
You learn new technologies rapidly because you're excited by solving hard infrastructure challenges.
You've scaled infrastructure before and understand the tradeoffs that matter.
You think most infrastructure moves too slowly and could be way better automated and optimized.
You're comfortable diving into unfamiliar systems and making them work reliably.
You are a self-starter who executes quickly, takes ownership, and constantly seeks improvement.
What you'll do:
Develop and maintain our core Python platform for routing requests, orchestrating AI workloads, managing GPU server capacity, observability, and more.
Develop and maintain our infrastructure layer using Terraform, Ansible, and cloud provider APIs to manage our fleet of GPU workers across cloud and potentially bare metal environments.
Own and operate the technologies underpinning our platform, potentially including K8s, FluxCD, Nomad, Prometheus, Thanos, Grafana, Loki, distributed networking/storage, etc.
Architect and implement solutions that directly impact the performance and availability of services for millions of ComfyUI users.
Work closely with our core engineering team to design and build new infrastructure systems.
Help create the vision and lay the foundation for where our infrastructure should go in the next 1/2/5 years.
Help shape our technical direction and infrastructure best practices as we grow.
Requirements:
Deep experience building and managing distributed compute platforms, preferably using Python.
Strong foundation in managing cloud infrastructure (AWS, GCP, or Azure). Experience with bare metal is a plus.
Solid understanding of container orchestration (Kubernetes preferred) and CI/CD principles and tools.
Excellent communication skills.
Proven ability to learn fast and ship quality infrastructure code and configurations.
Nice to have:
You have excelled at a fast-paced, high-growth tech startup before or are extremely excited about being in one.
Experience specifically with GPU management, scheduling, and monitoring in a large-scale environment.
Experience with specific observability tools (Prometheus, Grafana, Loki, Thanos).
Numbers & Facts
Location
San Francisco, California
Skills
Amazon Web Services (AWS)unmatched
Ansibleunmatched
Application Programming Interface (API)unmatched
Artificial Intelligence (AI)unmatched
Best Practicesunmatched
Capacity Managementunmatched
Cloud Computingunmatched
Communication Skillsunmatched
Computer Systemsunmatched
Continuous Deployment/Deliveryunmatched
Continuous Integrationunmatched
Divingunmatched
Fleet Managementunmatched
GCP (Good Clinical Practices)unmatched
GPU (Graphics Processing Unit)unmatched
Linux Operating Systemunmatched
Microsoft Windows Azureunmatched
Python Programming/Scripting Languageunmatched
Server Capacityunmatched
Software Engineeringunmatched
Startupunmatched
Systems Administration/Managementunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.