Top Remote Principal Software Engineer Jobs in Boston, MA

Principal IC responsible for reliability, observability, and modernization of a .NET-based Platform Services portfolio on Azure. Own architecture, resilience patterns, shared libraries, and migration of legacy .NET services. Implement observability, event-driven messaging, and AI-first engineering practices while mentoring engineers and partnering with architecture teams.

Lead design and implementation of core platform infrastructure for an Agentic AI platform. Build high-performance Rust systems, support production deployments, collaborate with ML engineers, design scalable data architectures, troubleshoot performance and scalability issues, and cultivate a collaborative, inclusive engineering culture.

Lead remote engineering teams to design, architect, and deliver scalable, high-availability education technology platforms focused on content systems, workflows, and GenAI. Drive product and technical strategy, collaborate with product/design, implement cloud-native architectures, adopt agile practices, measure performance through data and testing, and continuously improve user engagement and platform reliability.

Lead architecture and development of high-performance, scalable backend systems for Yahoo Mail using Java and C++. Set technical strategy, establish architectural standards, validate AI-generated code, mentor senior engineers, collaborate cross-functionally, and ensure reliability through automated logging, telemetry, and debugging workflows.

Lead a small AI-First engineering team to design, orchestrate, and verify agent-driven development workflows. Define agent toolchains, context engineering, and governance; architect full-stack applications; enforce multi-layer verification and automated QA; mentor engineers; optimize token/cost; and continuously improve AI-assisted SDLC practices and standards.

Design, implement, and operate cloud-scale telemetry platforms and data pipelines for Azure Monitor. Lead cross-team architecture, mentor engineers, improve AI-enabled development practices, ensure security/compliance, and resolve complex production incidents.

Lead architecture and implementation of large-scale, elastic Pub/Sub and messaging services. Define scalable, reliable designs, mentor engineers, drive CI/CD and testing strategies, manage incidents, partner with PMs/EMs, and advance AI tooling across the SDLC to enable real-time analytics and integrations.

Lead technical strategy and architecture for Azure Storage geo-replication, data protection, failover orchestration, and business continuity. Drive cross-team delivery, operational excellence, telemetry, automation, AI-assisted operations, and represent the team in executive and customer engagements.

Founding engineer responsible for architecting and building core product systems, writing scalable Python backend code, designing and maintaining AI/ML infrastructure, instituting best development practices (testing, CI/CD), collaborating on product roadmap, and mentoring future engineers.

Design, build, test, deploy, and operate scalable, secure Azure networking software and automation tools. Act as DRI, monitor production, troubleshoot incidents, run root-cause analysis, and drive reliability, performance, and cost improvements. Collaborate with PMs and architects, participate in design/code reviews, mentor engineers, and champion security, privacy, and compliance.

Design, implement, and ensure quality of systems stack, tools, and SDK integration for AI frameworks. Collaborate with hardware and ML teams, apply engineering principles, write low-level/high-performance code, define architecture, estimate scope, and drive coding standards.

Lead design and implementation of advanced systems features for Postgres, focusing on performance optimization and scalability. Mentor engineers and drive architectural direction for large-scale database systems.

The Principal Software Engineer will lead the technical strategy for high-concurrency services, oversee backend design, integrate AI, and ensure operational excellence at Cars Commerce.

The Principal Software Engineer leads a team to develop full-stack real-time applications, integrates machine learning models, and influences software architecture in cloud environments while supporting healthcare analytics.

Lead architecture and engineering for Azure core platform: define technology requirements, resolve cross-team issues, drive systemic reliability/performance improvements, mentor engineers, support on-call operations, and apply AI/ML to cloud operations.

Lead design and delivery of a hyperscale deployment platform using AI to improve reliability and automation. Mentor engineers, own end-to-end features, drive automation and AI-powered solutions, and ensure high-quality, scalable, maintainable production software.

Lead design and operation of a massively distributed edge compute platform using hyperscaler services and Kubernetes. Design external APIs, optimize L7 traffic routing, ensure high availability, fault tolerance, security and data privacy. Collaborate across AI/ML, hardware, network, and security teams, present scalability and reliability metrics to executives, mentor engineers, and establish architectural governance.

Design and build Azure Kubernetes Service features and AI-native infrastructure, improve service reliability and developer velocity, automate incident prevention/remediation, integrate AI tools, and operate distributed, containerized systems at cloud scale.

Lead design, build, and operate cloud-scale services to improve GPU inference efficiency and utilization across Azure. Translate research into production infrastructure, build telemetry and control-plane systems, drive architecture for workload placement and capacity management, and mentor engineers to deliver reliable, secure, and maintainable inference-serving systems at fleet scale.

Design and operate large-scale, AI-native cloud infrastructure (especially Kubernetes/AKS). Improve service quality, automate incident prevention/remediation, accelerate engineering productivity, and integrate AI tools into development workflows.

Lead architecture and technical strategy across an infrastructure platform ecosystem. Drive hands-on architectural improvements to graph engine and backend services, reduce technical debt, establish standards, champion AI-first engineering practices, run architecture/code reviews and mentorship, and collaborate with product and leadership to ensure scalable, extensible systems.

Architect and build AI-native production systems across a multi-language stack, design offline and online evaluation frameworks for LLMs, monitor live model behavior and drift, lead architecture reviews, mentor senior engineers, and prototype and ship AI capabilities while ensuring reliability and correctness in a regulated domain.

Lead design, development, and support of enterprise infrastructure and services. Drive architecture discussions, prototypes, capacity planning, and system launches. Troubleshoot performance, collaborate across teams and open-source communities, document solutions, and support on-call rotations to ensure reliable, scalable cloud and Linux-based systems.

Design and deliver large-scale, cloud-native and AI-enabled Kubernetes/AKS solutions. Implement, optimize, and maintain Kubernetes components and container orchestration across Azure, on-prem, and edge. Integrate AI capabilities, participate in on-call rotations, mentor engineers, and collaborate cross-functionally to improve reliability, observability, performance, and operational consistency at scale.

Design, implement, and operate production-quality AI framework components, benchmark and optimize large model training and inference across GPUs and Microsoft hardware, build automation and observability, drive cross-team projects from definition to deployment, and provide technical leadership and mentorship for improvements in performance, reliability, and model onboarding velocity.