Principal Software Engineer

Joining the C+AI organization at Microsoft means becoming part of the team that builds the end-to-end AI stack powering Azure’s innovation. As a member of the FIT training team within C+AI, you will help develop the AI infrastructure that accelerates the creation of agentic AI systems across Microsoft. This role is dedicated to advancing scientific methods and scalable infrastructure for training agentic models to achieve frontier-level performance. You will contribute to LLMs, SLMs, and agentic models using both proprietary and open-source frameworks, all aimed at delivering reliable, enterprise-grade agentic workflows.  

We are seeking a curious, independent, adaptable problem-solver who thrives on continuous learning, embraces changing priorities, and is motivated by creating meaningful impact. Candidates must be able to lead and role models for team that is driven, able to write efficient code, debug complex training jobs, document findings, and demonstrate a track record of continuous improvement. In 

addition, we value an agile, startup-style mindset - someone who can iterate quickly, pivot when needed, and collaborate effectively in fast-paced, dynamic environments.  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.  

Responsibilities

As a member of our team, you will participate in developing innovative solutions across AI Platform. Responsibilities include the following.   

• Collaboration with engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.  
• Design, build and improve services with high scalability and reliability.  
• Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements. 
• Participate in efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments. 
• Contribute to the deployment and monitoring of services in production environments.

Qualifications

Required Qualifications: 

• Bachelors Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Preferred Qualifications:

• Masters Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelors Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience. 
• 5+ years of software engineering experience, with significant ownership of production services, cloud platforms, distributed systems, or developer infrastructure.
• Strong experience building and operating containerized platforms using Kubernetes or similar orchestration systems.
• Strong coding skills in one or more systems or backend languages such as Python, Go, Rust, C++, C#, or Java.
• Experience designing reliable production APIs, backend services, or control-plane systems that manage compute, storage, networking, or runtime environments.
• Solid understanding of cloud infrastructure fundamentals, including identity, networking, storage, observability, capacity planning, security, and safe deployment practices.
• Experience diagnosing production issues using logs, metrics, traces, dashboards, and incident response processes.
• Demonstrated ability to lead technical design and retrospective, drive ambiguous projects to completion, mentor other engineers, and collaborate across teams
• Experience with Microsoft Azure, AWS, or Google Cloud, especially managed Kubernetes, container registries, object storage, private networking, identity, secrets, and monitoring services.

• Experience building multi-tenant platforms where reliability, fairness, quota management, isolation, and security are important.
• Experience with sandboxed execution environments, remote development environments, hosted notebook/tool environments, evaluation infrastructure, or ephemeral compute platforms.
• Experience with container image build systems, registry authentication, image caching, package caching, artifact distribution, or startup-latency optimization.
• Experience with cloud networking concepts such as ingress, DNS, proxies, egress control, private endpoints, service routing, and traffic management.
• Experience with secure runtime design, including authentication, authorization, workload identity, secret handling, network isolation, and protecting shared infrastructure from untrusted workloads.
• Experience with AI infrastructure, agent execution, evaluation platforms, GPU workloads, Windows/Linux runtime environments, or VM/container hybrid systems.
• Experience improving service operability through structured logging, distributed tracing, dashboards, alerting, automated validation, and incident playbooks.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.