Top Tech Jobs & Startup Jobs in Boston, MA

Build and optimize Azure Storage’s hyperscale distributed file system. Responsibilities include designing and implementing storage features, analyzing performance, ensuring availability, security, reliability, and durability, creating technical designs, estimating work, monitoring services on call, and improving observability and operational efficiency at scale.

Design, build, and maintain reliable, high-scale multi-tenant services with emphasis on security, resilience, testability, and automation. Collaborate cross-team, participate in on-call rotation, support live services in Azure air-gapped regions, and contribute to new service buildouts and operational reliability.

Design, implement, and optimize large-scale distributed training infrastructure and telemetry for GPU clusters. Profile, benchmark, and debug performance across compute, memory, networking, and storage. Improve collective communication libraries and collaborate with ML researchers and hardware teams to scale models, optimize accelerators, and deliver fleet-wide efficiency improvements and automated recommendations.

Lead data science strategy across complex customer engagements, turn ambiguous business problems into repeatable ML solutions, define modeling and evaluation standards, drive data readiness and MLOps practices, mentor teams, produce reusable IP, and represent Microsoft in executive and thought-leadership forums.

Build and maintain a capacity management portal and observability features for ML training and inference. Partner with researchers and PMs to turn requirements into intuitive UIs, integrate backend APIs across schedulers and training frameworks, develop internal tooling, and drive architectural improvements and best practices to improve efficiency and model quality visibility.

Customer-facing role to drive security transformation on Azure and Microsoft 365. Architect, design, and implement cloud security, identity, threat protection, and information protection solutions; run design sessions, perform hands-on evaluations (Defender, Sentinel, AAD, Intune), troubleshoot implementations, and influence product and engineering teams to improve customer security posture and adoption.

Design, implement, test, and maintain cloud-scale services and platform components for security‑critical, highly regulated environments. Collaborate with security, operations, and compliance teams, respond to incidents and on‑call rotations, apply secure‑by‑design principles, and support service reliability and operational excellence.

Design, implement, and operate production-quality AI framework components, benchmark and optimize large model training and inference across GPUs and Microsoft hardware, build automation and observability, drive cross-team projects from definition to deployment, and provide technical leadership and mentorship for improvements in performance, reliability, and model onboarding velocity.

Lead definition of system and silicon architecture for Windows devices, translating workloads and product goals into SoC/system requirements. Drive silicon roadmaps, co-design across hardware and software teams, build workload/system models, define KPIs/tradeoffs (compute, memory, power, thermal, security), and align partners and engineering teams from early definition through silicon and product execution.

Job posting for Microsoft Software Engineer (IC3/IC4 levels). Lists base pay ranges for U.S. and SF/NY metro areas, application timing, and equal opportunity statement. No specific responsibilities or technical requirements provided.