MassMutual Logo

MassMutual

AI Platform Engineer

Posted Yesterday
Be an Early Applicant
Hybrid
Boston, MA, USA
164K-215K Annually
Senior level
Hybrid
Boston, MA, USA
164K-215K Annually
Senior level
Lead design and delivery of MassMutual's AI platform components (LLM gateway, model serving, multi-tenant compute). Own architecture, technical execution, reliability (SLOs/observability), governance controls, and cross-team alignment. Provide technical leadership through design reviews, ADRs, and hands-on pairing.
The summary above was generated by AI
The Opportunity
MassMutual's AI Platform Engineering team is seeking an impact-driven AI Platform Engineer to serve as the technical anchor of our high-performing team. You will lead the design, deployment, set engineering standards, and drive the most complex platform initiatives from concept through production.
The Team
This is a unique opportunity to work on the team that builds and operates the platform powering MassMutual's AI initiatives. The team operates at the intersection of cloud infrastructure, AI/ML systems, and developer experience-delivering foundational capabilities that shape how the entire organization builds and deploys AI. We partner closely with AI engineering, product, and cloud engineering teams across the enterprise, and we invest in growth through a culture of peer learning, candid feedback, and shared technical standards. This team is defined by a shared commitment to engineering excellence, clear documentation, and the kind of technical leadership that makes hard problems tractable.
The Impact
  • Define architectural direction at the AI platform component level-cloud infrastructure, AI serving layers, developer tooling, and reliability strategy-and translate it into a concrete, prioritized roadmap.
  • Lead design on one of the platform's most critical components-LLM gateway, multi-tenant compute isolation, model serving infrastructure, and enterprise integration patterns. Write ADRs that become the team's engineering standards.
  • Serve as the first point of technical escalation for hard engineering decisions. Run design reviews, provide deep technical feedback on pull requests, and pair with engineers on the gnarliest problems.
  • Own the technical execution of major platform initiatives end to end-scoping, sequencing work, managing technical risk, and driving to production without losing quality.
  • Lead platform reliability strategy: define SLOs, shape the observability strategy, lead incident reviews, and continuously raise the bar on platform stability and operational maturity.
  • Lead technical design of governance and compliance controls-data residency, access management, audit logging, and AI usage policies-to satisfy enterprise customer requirements and compliance frameworks.
  • Drive cross-team alignment with AI engineering, product, and cloud engineering teams; communicate technical trade-offs clearly and represent platform capabilities to senior stakeholders.
  • Raise the technical craft of the team through thorough design reviews, documentation habits, and hands-on pairing-without managing anyone directly.

The Minimum Qualifications
  • 5+ years in platform, infrastructure, or SRE, with a track record as a technical lead or staff-level IC with team-wide technical scope.
  • Certified Kubernetes Administrator (CKA), Certified Kubernetes Application Developer (CKAD) or equivalent AWS Certifications.
  • 3+ years experience in cloud-native architecture: Kubernetes at scale, managed cloud services, networking, identity federation, and multi-tenancy patterns across AWS, GCP, or Azure.
  • 3+ years experience of proven ownership of complex, multi-month platform initiatives-driven from whiteboard to production, managing ambiguity and technical risk throughout.

The Ideal Qualifications
  • Strong IaC and GitOps fluency: Terraform or Pulumi, ArgoCD, with experience standardizing platform tooling and deployment patterns across engineering teams.
  • Hands-on experience with AI/ML infrastructure: model serving, inference pipelines, GPU resource management, or LLM integration patterns.
  • Experience mentoring engineers and influencing technical direction across teams.
  • Strong written communication: clear design docs, useful ADRs, and the ability to explain architectural decisions to both engineers and non-technical stakeholders.
  • LLM serving at scale-vLLM, Triton, Ray Serve-or experience with AI gateway design patterns.
  • Experience building an internal developer platform (IDP) from scratch, with a product mindset that obsesses over internal developer experience.
  • Strong grasp of AI safety, model evaluation, and governance frameworks.
  • Ability to lead through technical credibility-influencing design decisions, driving alignment, and raising quality without formal authority.
  • FinOps or GPU cost optimization experience across large inference workloads.
  • Open-source contributions to platform or ML infrastructure tooling.
  • Comfort with ambiguity: energized by undefined problem spaces, with a habit of building clarity and shared context where there isn't any.

What to Expect as Part of MassMutual and the Team
  • Regular meetings with the AI Platform Engineering team
  • Focused one-on-one meetings with your manager
  • Networking opportunities including access to Asian, Hispanic/Latinx, African American, women, LGBTQIA+, veteran and disability-focused Business Resource Groups
  • Access to learning content on Degreed and other informational platforms
  • Your ethics and integrity will be valued by a company with a strong and stable ethical business with industry leading pay and benefits

#LI-SC1
MassMutual is an equal employment opportunity employer. We welcome all persons to apply.
If you need an accommodation to complete the application process, please contact us and share the specifics of the assistance you need.
California residents: For detailed information about your rights under the California Consumer Privacy Act (CCPA), please visit our California Consumer Privacy Act Disclosures page.
Salary Range: $163,900-$215,000

MassMutual Boston, Massachusetts, USA Office

Our new Boston campus opened in November in the Seaport neighborhood.

Just like MassMutual, Boston's Seaport district is surrounded by decades of history, yet is now being recognized as a hub for digital innovation and professional growth. With us you can develop the skills you need to build a successful future and connect with talented and collaborative colleagues working together to help people secure their future and protect the ones they love.

Similar Jobs at MassMutual

23 Days Ago
Hybrid
Boston, MA, USA
134K-176K Annually
Junior
134K-176K Annually
Junior
Big Data • Fintech • Information Technology • Insurance • Financial Services
Design, build, and operate AI platform components (LLM gateway, model serving, developer tooling). Own features from development to production, contribute to reliability, observability, governance, and cross-functional integration while producing technical documentation and participating in design reviews.
Top Skills: ArgocdAWSAzureContainerization (Docker)GCPGitopsIacKubernetesLlm GatewayPulumiRay ServeTerraformTritonVllm
4 Hours Ago
Hybrid
Boston, MA, USA
100K-131K Annually
Mid level
100K-131K Annually
Mid level
Big Data • Fintech • Information Technology • Insurance • Financial Services
Perform IT audits and assessments across enterprise systems and applications, focusing on cybersecurity, cloud, AI, and digital infrastructure. Evaluate inherent and residual risks, test control design and effectiveness, set audit scope, and deliver value-added recommendations while mentoring associates and collaborating with stakeholders to mitigate technology risks.
Top Skills: AICloud ComputingCybersecurityDigital Infrastructure
Yesterday
Hybrid
138K-181K Annually
Senior level
138K-181K Annually
Senior level
Big Data • Fintech • Information Technology • Insurance • Financial Services
Senior SOC analyst performing advanced malware analysis, extracting IOCs, building SOAR automations, partnering with data science for AI capabilities, tuning detections and alerting, mentoring junior analysts, and ensuring QA and documentation.
Top Skills: AWSAzureDnsHttp/SMitre Att&CkOauthPowershellPythonSAMLSIEMSoarTask SchedulerTcp/IpThreat Intelligence PlatformWindows RegistryWmic

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account