Microsoft Logo

Microsoft

Senior Software Engineer, AI Infra Management and Ops

Posted 2 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
120K-304K Annually
Senior level
Remote
Hiring Remotely in United States
120K-304K Annually
Senior level
Design and evolve cloud-native services, distributed systems, and infrastructure platforms at scale. Lead architecture and technical direction across compute, networking, storage, AI infrastructure, HPC, GPU environments, and datacenter systems. Improve automation, observability, reliability, security, CI/CD, and developer productivity while collaborating across engineering organizations. Mentor engineers and contribute to architecture reviews and operational excellence for large-scale production platforms.
The summary above was generated by AI
Overview
Help shape the future of cloud infrastructure and artificial intelligence platforms at unprecedented scale. Our team is building the foundational platform capabilities that power large-scale distributed systems, accelerated computing environments, and next-generation cloud services. You will work at the intersection of software, infrastructure, networking, and datacenter technologies to enable reliable, secure, and scalable platforms that support a broad range of business-critical workloads. You will collaborate with engineering teams across Microsoft to advance platform capabilities, accelerate innovation, and improve operational excellence across diverse infrastructure environments.
 
As a Senior Software Engineer, you will lead the design and evolution of cloud-native platforms, distributed systems, and infrastructure services that support service lifecycle management, resource orchestration, observability, reliability, and automation. You will help guide technical strategy across multiple engineering investments, contribute to architecture decisions involving compute, networking, storage, and platform services, and collaborate across organizations to deliver capabilities that improve platform efficiency and developer productivity. This opportunity will allow you to deepen your expertise in distributed systems and cloud infrastructure, expand your influence across engineering organizations, and contribute to innovations in Artificial Intelligence (AI) infrastructure, graphics processing unit (GPU) platforms, high-performance networking, and large-scale datacenter systems.
 
Microsoft's mission is to empower every person and every organization on the planet to achieve more. We cultivate a culture grounded in respect, integrity, accountability, inclusion, collaboration, and continuous learning, enabling individuals and teams to grow, contribute, and make meaningful impact.

Responsibilities
  • Design, develop, and maintain cloud-native services and distributed systems that support platform capabilities, service lifecycle management, and operational excellence at scale.
  • Collaborate across engineering organizations to help define technical direction and architecture for platform infrastructure, cloud services, networking, storage, compute, and operational excellence investments.
  • Guide the development of platform engineering capabilities that improve deployment automation, service lifecycle management, observability, reliability, scalability, and developer productivity.
  • Advance software engineering practices including Continuous Integration and Continuous Delivery (CI/CD), Infrastructure as Code (IaC), testing, security, monitoring, and operational readiness throughout the engineering lifecycle.
  • Contribute to the design and operation of Artificial Intelligence (AI) infrastructure, High Performance Computing (HPC) platforms, bare-metal infrastructure, graphics processing unit (GPU) environments, and large-scale distributed computing systems.
  • Collaborate on datacenter architecture and networking solutions, including rack-scale systems, network topology design, Ethernet fabrics, InfiniBand fabrics, Remote Direct Memory Access (RDMA), Smart Network Interface Cards (SmartNICs), Data Processing Units (DPUs), and accelerated computing platforms.
  • Foster a culture of technical excellence through architecture collaboration, mentorship, knowledge sharing, design review participation, and support for engineering excellence across the broader organization

Qualifications

Required Qualifications: 

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
 

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter 

Preferred Qualifications: 

  • Recognized for delivering technical solutions that span multiple engineering teams, organizations, or business areas.
  • Demonstrated ability to simplify complex technical challenges and translate them into practical, scalable, and maintainable solutions.
  • Proven ability to influence technical direction through collaboration, architectural leadership, technical mentoring, and cross-organizational partnerships.
  • Knowledge of large-scale distributed systems, cloud-native platforms, or infrastructure services supporting business-critical production environments.
  • Familiarity with Artificial Intelligence (AI) infrastructure, High Performance Computing (HPC) environments, accelerated computing platforms, or large-scale graphics processing unit (GPU) deployments.
  • Knowledge of datacenter architecture, rack-scale infrastructure, network topology design, and modern datacenter networking technologies.
  • Familiarity with InfiniBand fabrics, NVLink, NVSwitch, Ethernet networking, Remote Direct Memory Access (RDMA), Smart Network Interface Cards (SmartNICs), or Data Processing Units (DPUs) supporting large-scale compute environments.
  • Understanding of bare-metal infrastructure, hardware lifecycle management, fleet operations, infrastructure telemetry, or platform operations at scale.
  • Proficiency in one or more modern programming languages such as Go, Rust, C#, Java, or Python.

#AIINFRA


Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Microsoft Cambridge, Massachusetts, USA Office

255 Main Street, Cambridge, MA 02142, Cambridge, United States, 02142

Similar Jobs

9 Minutes Ago
Remote or Hybrid
United States
200K-317K Annually
Senior level
200K-317K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Lead Cloudflare’s consumption strategy across go-to-market teams. Define consumption metrics, targets, roadmap, rules of engagement, and capacity-planning methods. Coordinate pricing, finance, product, sales, IT, and developer teams through launch and ongoing improvement. Guide field enablement, resolve cross-functional ownership and crediting issues, manage a specialist, and use AI tools to improve reporting and analysis. The role requires extensive GTM strategy or revenue operations experience, program leadership, sales planning expertise, and familiarity with usage-based business models.
Top Skills: Ai Assistants And AgentsCloud ComputingDeveloper PlatformsSaaSUsage-Based Billing Systems
10 Minutes Ago
Remote or Hybrid
United States
120K-190K Annually
Senior level
120K-190K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Build and improve consumption and revenue target-setting models, scorecards, territory analytics, and governed data products. Validate revenue, ownership, billing, and CRM data; support field questions and Rules of Engagement; reconcile data with Finance and Billing; and partner with Geo Ops, RevOps, Engineering, IT, and Compensation. Use SQL, BigQuery, dashboards, and AI tools to automate analysis, improve data integrity, and scale recurring reporting and support.
Top Skills: Ai Assistants And AgentsBigQueryBilling SystemsCrm SystemsSalesforceSQL
15 Minutes Ago
Remote or Hybrid
97K-165K Annually
Senior level
97K-165K Annually
Senior level
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Manages financial planning and cost controls for defense modernization programs. Establishes cost baselines, maintains change management, monitors actuals against budgets, develops EAC and ETC forecasts, performs variance analysis, applies Earned Value Management, and generates cost trend reports. Ensures compliance with internal controls and regulatory standards while coordinating with Finance on charging, accruals, and resource costing. The role is onsite in Kingsport, Tennessee, with periodic travel to Radford, Virginia.
Top Skills: Earned Value Management (Evm)ExcelPower BI

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account