Flagship Pioneering Logo

Flagship Pioneering

Lead, Product Safety & Wellbeing

Reposted 22 Days Ago
Be an Early Applicant
In-Office
Cambridge, MA, USA
138K-182K Annually
Expert/Leader
In-Office
Cambridge, MA, USA
138K-182K Annually
Expert/Leader
Leads product safety and wellbeing strategy for AI-powered experiences. Owns safety roadmaps, guardrails, evaluation frameworks, benchmarks, metrics, monitoring, launch-readiness criteria, and human or automated evaluation programs. Assesses failure modes and emerging risks, including self-harm and crisis scenarios, and translates expert and user findings into product guidance. Partners with engineering, machine learning, product, design, and data science teams to improve risk detection, response generation, escalation, and user experience.
The summary above was generated by AI

The Company 

Iris Labs, Inc. is a privately held, early-stage company pioneering the use of artificial intelligence to transform how people navigate life’s challenges and wellbeing. We are creating a platform that empowers people to build a life they are proud of and fulfilled by. We bring together psychology, product, design, engineering, and machine learning to build digital experiences that are engaging, trustworthy, and genuinely helpful.   

Iris Labs is backed by Flagship Pioneering, an innovation enterprise that conceives, creates, resources, and builds companies that invent breakthrough technologies that transform the world. Flagship has created over 100 groundbreaking companies since 2000, including Moderna. 

The Role 

We're looking for an experienced and creative leader to own and continually improve product performance. This person will lead on how we define and measure safety, and partner across disciplines to strengthen our evaluations, safety systems, and user experience. This role sits at the intersection of psychology, AI, product development, and applied research. Candidates should have a strong background in clinical science with the ability to lead projects and communicate effectively across teams to translate insights into actionable and meaningful improvements across AI tools and workflows. The role offers a unique opportunity to help drive the strategy of an early stage AI-focused company. 

The ideal candidate is a self-starter who knows how to balance safety, quality, and rigor with speed and experimentation. They are passionate about creating user experiences that help people feel supported, understood, and empowered in their everyday lives. This dynamic role offers significant opportunities for impact and professional growth, helping shape how AI can responsibly support wellbeing at scale. 

Key Responsibilities 

  • Serve as the subject matter expert on safety systems, owning the safety roadmap and continuously improving guardrails as the product evolves. 
  • Develop a deep, data-driven understanding of product performance across safety risks; identify strengths, limitations, failure modes, emerging risks, and opportunities for improvement. 
  • Develop and evolve safety frameworks, benchmarks, evaluation methodologies, rubrics, quality standards, and meaningful safety metrics. 
  • Lead human and automated evaluation programs, including annotation programs, annotator and AI judge training and calibration, and improvements to evaluation reliability and scalability. 
  • Conduct qualitative and quantitative reviews from both expert and user perspectives, translating findings into clear, actionable product recommendations. 
  • Partner with Engineering, ML, Product, and Data Science to improve risk detection, prompting strategies, response generation, routing and escalation logic, automated evaluation pipelines, and the overall user experience. 
  • Prototype and test new safety approaches, product features, and user experiences to improve safety and broader product quality. 
  • Own ongoing safety monitoring and assessment, including dashboards, key metrics, trend analysis, emerging risk identification, safety reviews, and refinement of safety protocols. 
  • Evolve and own safety and launch-readiness criteria for new features and capabilities, identifying risks and ensuring appropriate mitigations are in place. 

Qualifications: 

  • Advanced training (PhD, PsyD, LCSW, or equivalent experience) in psychology, behavioral science, mental health, or a closely related field 
  • Deep expertise in psychological safety, crisis response, and risk assessment; strong judgment around conversations involving emotional distress, self-harm, suicide, abuse, or other sensitive situations 
  • Experience developing evaluation frameworks or quality assurance processes 
  • Excellent communication, analytical, and problem-solving skills with the ability to translate expertise into clear operational and product guidance for AI systems. 
  • Ability to collaborate effectively with engineers, researchers, designers, and product managers 
  • Ability to make and communicate tradeoffs and clear decisions in ambiguous environments 
  • Experience building with LLMs, conversational AI, or generative AI products 
  • Up to date on current clinical AI best practices and emerging guidelines and standards.

Preferred Qualifications: 

  • Experience leading annotation or human evaluation programs 
  • Experience developing AI evaluation benchmarks or automated evaluation systems 
  • Experience working closely with product or engineering teams 

About Flagship 

Flagship Pioneering is a bioplatform innovation company that invents and builds platform companies, each with the potential for multiple products that transform human health or sustainability. Since its launch in 2000, Flagship has originated and fostered more than 100 scientific ventures, resulting in more than $90 billion in aggregate value. Many of the companies Flagship has founded have addressed humanity’s most urgent challenges: vaccinating billions of people against COVID-19, curing intractable diseases, improving human health, preempting illness, and feeding the world by improving the resiliency and sustainability of agriculture.  Flagship has been recognized twice on FORTUNE’s “Change the World” list, an annual ranking of companies that have made a positive social and environmental impact through activities that are part of their core business strategies, and has been twice named to Fast Company’s annual list of the World’s Most Innovative Companies. Learn more about Flagship at www.flagshippioneering.com. 

Flagship Pioneering and our ecosystem companies are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.  

At Flagship, we recognize there is no perfect candidate. If you have some of the experience listed above but not all, please apply anyway. Experience comes in many forms, skills are transferable, and passion goes a long way. We are dedicated to building diverse and inclusive teams and look forward to learning more about your unique background. 

Recruitment & Staffing Agencies: Flagship Pioneering and its affiliated Flagship Lab companies (collectively, “FSP”) do not accept unsolicited resumes from any source other than candidates. The submission of unsolicited resumes by recruitment or staffing agencies to FSP or its employees is strictly prohibited unless contacted directly by Flagship Pioneering’s internal Talent Acquisition team. Any resume submitted by an agency in the absence of a signed agreement will automatically become the property of FSP, and FSP will not owe any referral or other fees with respect thereto. 


Privacy Notice for Applicants: When you apply for a role at Flagship Pioneering or one of its portfolio companies, we collect and use personal information you provide (such as your name, contact details, work history, and application materials) to evaluate your application, communicate with you, and comply with legal obligations. Your application data is processed through Greenhouse, our applicant tracking system, and may also be reviewed using AI-assisted screening tools. We do not sell your personal information. California residents have rights under the CCPA/CPRA including to know, delete, and opt out of the sharing of their personal information. If you are located in the EU or UK, we process your data under GDPR and you have rights to access, rectify, and erase your data. To exercise your rights or for questions, contact [email protected]. 

The salary range for this role is $138,000 - $181,500. Compensation for the role will depend on a number of factors, including a candidate’s qualifications, skills, competencies, and experience. Iris Labs, Inc. currently offers healthcare coverage, annual incentive program, retirement benefits and a broad range of other benefits. Compensation and benefits information is based on Iris Labs, Inc.'s good faith estimate as of the date of publication and may be modified in the future.


Privacy Notice for Applicants: When you apply for a role at Flagship Pioneering or one of its portfolio companies, we collect and use personal information you provide (such as your name, contact details, work history, and application materials) to evaluate your application, communicate with you, and comply with legal obligations. Your application data is processed through Greenhouse, our applicant tracking system, and may also be reviewed using AI-assisted screening tools. We do not sell your personal information. California residents have rights under the CCPA/CPRA including to know, delete, and opt out of the sharing of their personal information. If you are located in the EU or UK, we process your data under GDPR and you have rights to access, rectify, and erase your data. To exercise your rights or for questions, contact [email protected]. 

HQ

Flagship Pioneering Cambridge, Massachusetts, USA Office

55 Cambridge Parkway, Suite 800E, Cambridge, MA, United States, 02142

Similar Jobs

9 Minutes Ago
Remote or Hybrid
16 Locations
125K-125K Annually
Senior level
125K-125K Annually
Senior level
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Leads NinjaOne’s FedRAMP High and Moderate compliance program, including authorization, continuous monitoring, audits, control testing, POA&M management, vulnerability remediation, documentation, and assessor coordination. Partners with engineering and federal stakeholders to implement controls, maintain evidence, manage cloud security dependencies, track regulatory changes, and automate compliance workflows. Provides FedRAMP subject matter expertise to internal teams, customers, and prospects while improving audit efficiency and evidence quality.
Top Skills: AWSAws Security HubAzureGCPKqlLucidchartMicrosoft VisioOscalPythonQualysRegoSQLTenableWiz
16 Minutes Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
250K-295K Annually
Senior level
250K-295K Annually
Senior level
Artificial Intelligence • Machine Learning • Software
Leads the technical direction, architecture, and roadmap for agentic machine learning systems processing global trade data. Builds ingestion, document understanding, entity resolution, inference, evaluation, observability, and feedback systems. Adapts and post-trains LLMs, ships production AI agents, mentors engineers, sets technical standards, and partners with product, engineering, data science, and customers to deliver risk, compliance, and enforcement capabilities.
Top Skills: AWSAzureBraintrustClaude CodeCursorDatabricksDockerFaissFrontier Model ApisGitHugging FaceKubernetesLanggraphLangsmithMlflowNumpyOpensearchPandasPolarsPostgresPythonPyTorchScikit-LearnSparkSwagger/OpenapiVllm
17 Minutes Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
205K-240K Annually
Senior level
205K-240K Annually
Senior level
Artificial Intelligence • Machine Learning • Software
Lead the technical direction and development of production machine learning and agentic systems for global trade risk, compliance, and enforcement. Responsibilities include designing data-to-decision pipelines, adapting and post-training LLMs, building evaluation and observability systems, improving model performance, mentoring engineers, and partnering with product, customers, and cross-functional teams to ship AI capabilities.
Top Skills: AWSAzureBraintrustClaude CodeCursorDatabricksDockerDpoEmbedding Fine-TuningFaissGitHugging FaceKubernetesLanggraphLangsmithLlmopsMlflowNumpyOpensearchPandasPolarsPostgresPythonPyTorchRagRe-RankersReward ModelingRlaifRlhfScikit-LearnSftSparkStructured OutputsSwagger/OpenapiTool/Function CallingVector SearchVllm

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account