Senior Software Engineer

Overview

The HPC/AI (High-Performance Computing and Artificial Intelligence) team builds the networking and systems infrastructure that powers Azures largest AI supercomputing clusters. We develop scalable distributed systems, communication libraries, and network technologies that enable efficient training and deployment of next-generation AI models across thousands of accelerators.

Were seeking Senior Software Engineers to solve challenging problems in backend network architecture, RDMA communication libraries, network transport protocols, and large-scale distributed systems. Youll work on technologies that deliver ultra-low latency, high throughput, and predictable performance for distributed AI workloads, where communication efficiency directly impacts model training and inference performance.

In this role, youll design and build next-generation networking solutions spanning transport protocols, collective communication frameworks, observability systems, and performance optimization technologies. Youll develop RDMA-based communication libraries and networking software that operate at the scale of modern AI supercomputers, enabling efficient communication across large GPU and accelerator clusters.

Youll collaborate closely with engineers across networking, hardware, silicon, AI frameworks, and datacenter infrastructure to deliver end-to-end solutions. Your work will involve performance analysis, scalability optimization, fault tolerance, telemetry, and the development of innovative networking technologies that advance the state of large-scale distributed AI systems.

Generative AI and distributed computing are driving unprecedented demand for scalable infrastructure. As a Senior Software Engineer on our team, youll help shape the networking backbone behind Azures AI supercomputing platform, influencing how future generations of AI systems are built, trained, and deployed at global scale.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Design, develop, and optimize networking solutions for large-scale AI training and inference infrastructure, with a focus on performance, scalability, and reliability.
• Lead the design and implementation of network transport protocols, RDMA-based communication libraries, and distributed systems technologies that power AI supercomputing clusters.
• Analyze and optimize end-to-end communication performance, including latency, throughput, congestion management, collective communication efficiency, and workload scalability.
• Investigate and resolve complex networking and distributed systems challenges across production-scale AI infrastructure.
• Drive technical architecture, author design specifications, identify dependencies, and influence engineering decisions across multiple teams and technology areas.
• Collaborate across networking, hardware, silicon, AI framework, and infrastructure teams to deliver end-to-end solutions that improve the performance, reliability, and observability of large-scale AI systems.

Qualifications

Required Qualifications:

• Bachelors Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience.

Other Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
• These requirements include, but are not limited to the following specialized security screenings:
• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Masters Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

• OR Bachelors Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

• OR equivalent experience.

• 5+ years of experience in software design, development, and performance optimization of distributed systems, large-scale infrastructure, networking software, or communication libraries.

• 3+ years of experience with high-performance networking technologies and architectures, including RDMA, Ethernet or InfiniBand fabrics, transport protocols, or communication libraries.

• 1+ years of experience with hardware-software co-design involving networking, accelerators, GPUs, DPUs, NICs, or large-scale system architectures.

• 1+ years of experience with performance analysis, profiling, benchmarking, and optimization of distributed or HPC workloads.

#azurecorejobs

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.