HPC Operations Engineering Manager

Microsoft Corporation

Redmond, WA

Apply

JOB DETAILS

SALARY

$165,600–$296,400 Per Year

SKILLS

Amazon Web Services (AWS), Artificial Intelligence (AI), Automation, Bash Scripting, CPU (Central Processing Unit), Capacity Management, Computer Operations, Computer Science, Continuous Deployment/Delivery, Continuous Improvement, Continuous Integration, Cost Control, DevOps, Distributed Computing, Docker, Engineering, Engineering Management, Failover, GCP (Good Clinical Practices), GPU (Graphics Processing Unit), Go Programming Language (Golang), Home Automation, Hybrid Cloud, Identify Issues, Incident Management, Incident Response, Integrated Circuits (ICs), Leadership, Machine Tool, Microsoft Product Family, Microsoft Windows Azure, On Call, Operations Management, Operations Security (OPSEC), People Management, Power Amplifier, Process Improvement, Product Design, Product Development, Public Cloud, Python Programming/Scripting Language, Reliability Engineering, Scripting (Scripting Languages), Software Engineering, Startup, Systems Engineering, Team Lead/Manager, Team Player

LOCATION

Redmond, WA

POSTED

20 days ago

**Overview** Microsoft AI is seeking an experienced High Performance Computing Operations Engineering Manager to join our infrastructure team on the MAI SuperIntelligence Team. In this role, you'll lead a team of Site Reliability Engineers who blend software engineering and systems engineering to keep our large-scale distributed AI infrastructure reliable and efficient. You'll work closely with ML researchers, data engineers, and product developers to design and operate the platforms that power training, fine-tuning, and serving generative AI models. Microsoft Superintelligence Team Microsoft Superintelligence Team's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. This role is part of Microsoft AI's Superintelligence Team. The MAIST is a startup-like team inside Microsoft AI, created to push the boundaries of AI toward Humanist Superintelligence - ultra-capable systems that remain controllable, safety-aligned, and anchored to human values. Our mission is to create AI that amplifies human potential while ensuring humanity remains firmly in control. We aim to deliver breakthroughs that benefit society - advancing science, education, and global well-being. We're also fortunate to partner with incredible product teams giving our models the chance to reach billions of users and create immense positive impact. If you're a brilliant, highly-ambitious and low ego individual, you'll fit right in - come and join us as we work on our next generation of models! By applying to this Mountain View, CA position, you are required to be local to the San Francisco area and in office 4 days a week.? **Responsibilities** Responsibilities + Team leadership: Lead a team of experienced SREs to ensure uptime, resiliency and fault tolerance of AI model training and inference systems. + Observability: Design and help maintain monitoring, alerting, and logging systems to provide real-time visibility into model serving pipelines and infra. + Automation & Tooling: Lead building of automation for deployments, incident response, scaling, and failover in hybrid cloud/on-prem CPU+GPU environments. + Incident Management: Lead on-call rotations, troubleshoot production issues, conduct blameless postmortems, and drive continuous improvements. + Security & Compliance: Ensure data privacy, compliance, and secure operations across model training and serving environments. + Collaboration: Partner with ML engineers and platform teams to improve developer experience and accelerate research-to-production workflows. **Qualifications** Required Qualifications + Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with Site Reliability Engineering, DevOps, or Infrastructure Engineering Leadership roles AND 8+ years experience with Kubernetes, Docker, and container orchestration, AND 6+ years experience with programming/scripting skills not limited to Python, Go, or Bash + OR equivalent experience Preferred Qualifications: + Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience AND 10+ years experience with Kubernetes, Docker, and container orchestration, AND 10+ years' experience with public cloud platforms like Azure/AWS/GCP and infrastructure-as-code + OR equivalent experience + 6+ years people management experience. + 8+ years experience in monitoring & observability tools (Grafana, Datadog, OpenTelemetry, etc.). + Knowledge of CI/CD pipelines for Inference and ML model deployment. + Solid knowledge of distributed systems, networking, and storage. + Experience running large-scale GPU clusters for ML/AI workloads (preferred). + Familiarity with ML training/inference pipelines. + Experience with high-performance computing (HPC) and workload schedulers ( Kubernetes operators). + Background in capacity planning & cost optimization for GPU-heavy environments Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600.00 - $296,400.00 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800.00 - $331,200.00 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations. (https://careers.microsoft.com/v2/global/en/accessibility.html)

About the Company

Microsoft Corporation

DO WHAT YOU LOVE
Make your mark on the world’s most used technologies. Develop the next hit mobile application. Pioneer a startup that could be the next big thing. At Microsoft, you choose your path.

Headquartered in Redmond, Washington, Microsoft is a top innovator in both the consumer and enterprise technology industry. Just a few of the many things our products do are unleash creativity, connect businesses, and make learning more fun. But our continued success is based on one thing: our employees. We hire amazing, talented people and give them the opportunities—and the tools—to succeed.

WHY MICROSOFT?
As a Microsoft employee, you’re surrounded by a diverse group of the smartest people in your field. This fosters new ideas, better business results, and creates a dynamic work environment. In the office, you’re constantly challenged and supported by your colleagues. Every day holds something new and exciting.

We also offer unparalleled depth and breadth of career opportunities. As an industry leader in multiple fields, working for Microsoft means being able to do whatever you feel passionate about—and being able to make an impact in that field. From day one, we give our employees significant responsibility. This means that you’ll know that you directly contributed to something that has a positive impact on people worldwide. Whether you choose to work in management, dive deep into the newest technology, or explore multiple professions, you’ll find everything you need at Microsoft to drive your career—and to make a difference.

WE GET IT – YOU’RE MORE THAN YOUR JOB
Everyone works differently and is motivated by different things. We also understand that there’s more to you than your job. That’s why we offer competitive pay and a wide assortment of benefits-- to help you make the most of life at work and away from it.

GET THE BALL ROLLING

COMPANY SIZE

10,000 employees or more

INDUSTRY

Other/Not Classified

FOUNDED

1975

WEBSITE

http://www.microsoft.com

Resume Resources

Free Resume Templates Free Resume Builder