Senior Software Engineer

The HPC/AI (High-Performance Computing and Artificial Intelligence) team builds the networking and systems infrastructure that powers Azure's largest AI supercomputing clusters. We develop scalable distributed systems, communication libraries, and network technologies that enable efficient training and deployment of next-generation AI models across thousands of accelerators.

We're seeking Senior Software Engineers to solve challenging problems in backend network architecture, RDMA communication libraries, network transport protocols, and large-scale distributed systems. You'll work on technologies that deliver ultra-low latency, high throughput, and predictable performance for distributed AI workloads, where communication efficiency directly impacts model training and inference performance.
In this role, you'll design and build next-generation networking solutions spanning transport protocols, collective communication frameworks, observability systems, and performance optimization technologies. You'll develop RDMA-based communication libraries and networking software that operate at the scale of modern AI supercomputers, enabling efficient communication across large GPU and accelerator clusters.
You'll collaborate closely with engineers across networking, hardware, silicon, AI frameworks, and datacenter infrastructure to deliver end-to-end solutions. Your work will involve performance analysis, scalability optimization, fault tolerance, telemetry, and the development of innovative networking technologies that advance the state of large-scale distributed AI systems.
Generative AI and distributed computing are driving unprecedented demand for scalable infrastructure. As a Senior Software Engineer on our team, you'll help shape the networking backbone behind Azure's AI supercomputing platform, influencing how future generations of AI systems are built, trained, and deployed at global scale.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

• Design, develop, and optimize networking solutions for large-scale AI training and inference infrastructure, with a focus on performance, scalability, and reliability.
• Lead the design and implementation of network transport protocols, RDMA-based communication libraries, and distributed systems technologies that power AI supercomputing clusters.
• Analyze and optimize end-to-end communication performance, including latency, throughput, congestion management, collective communication efficiency, and workload scalability.
• Investigate and resolve complex networking and distributed systems challenges across production-scale AI infrastructure.
• Drive technical architecture, author design specifications, identify dependencies, and influence engineering decisions across multiple teams and technology areas.
• Collaborate across networking, hardware, silicon, AI framework, and infrastructure teams to deliver end-to-end solutions that improve the performance, reliability, and observability of large-scale AI systems. 

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Other Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
• These requirements include, but are not limited to the following specialized security screenings: 
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• 5+ years of experience in software design, development, and performance optimization of distributed systems, large-scale infrastructure, networking software, or communication libraries.
• 3+ years of experience with high-performance networking technologies and architectures, including RDMA, Ethernet or InfiniBand fabrics, transport protocols, or communication libraries.
• 1+ years of experience with hardware-software co-design involving networking, accelerators, GPUs, DPUs, NICs, or large-scale system architectures.
• 1+ years of experience with performance analysis, profiling, benchmarking, and optimization of distributed or HPC workloads.

#azurecorejobs

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.