RAI Institute Logo

RAI Institute

Sr. Research Scientist - Physically-Grounded World Modeling

Posted 23 Days Ago
Be an Early Applicant
In-Office
Cambridge, MA
Senior level
In-Office
Cambridge, MA
Senior level
The role involves researching and developing algorithms for modeling complex 3D scenes and engaging in collaborative, innovative work with a focus on robotics and AI.
The summary above was generated by AI
Our Mission:

Our mission is to solve the most important and fundamental challenges in AI and Robotics to enable future generations of intelligent machines that will help us all live better lives.

Our research group, a part of the RAI institute's Perception team, is dedicated to building the next generation of intelligent scene models. We focus on creating representations that are deeply grounded in the physics of the real world. We operate in a dynamic environment, translating research breakthroughs into demonstrable progress in physical intelligence. Our work exists at the intersection of two critical challenges:

Analysis (Understanding the Now): Deconstructing scenes into their fundamental components including 3D geometry, semantics, physical properties (like friction and mass), and dynamics (like articulation and forces).
Synthesis (What Happens Next?): Using this understanding to power generative world models, hybrid physics engines, and differentiable simulators that can predict how a scene will evolve over time, conditioned on agent actions.

We are looking for a Senior Research/Applied Scientist to push the frontiers of how machines perceive, reason about, and interact with the physical world.

What You Will Do:

  • Research, design, and implement novel algorithms for understanding and modeling complex 3D scenes, with a focus on integrating geometry, semantics, and physics
  • Develop and advance generative and physics-informed models capable of predicting realistic future states and dynamic interactions for applications like robotic manipulation
  • Design and curate large-scale datasets to enhance model capabilities in physically-grounded and specialized applications
  • Create robust 3D representations that capture not just object appearance, but also physical properties, affordances, and causal dymanics
  • Incorporate principled uncertainty estimation into your models to ensure they are reliable and aware of their own limitations
  • Collaborate with a multidisciplinary team of researchers and engineers to integrate your work into larger systems and build compelling demonstrations
  • Share your innovative work with the community through publications at top-tier conferences (e.g., CoRL, CVPR, NeurIPS)
  • Mentor junior researchers and engineers, fostering a culture of technical excellence and collaborative innovation

What We Are Looking For

  • A PhD, or MS with equivalent research experience in Computer Science, Robotics, or a related field
  • 5+ years of relevant post-graduate research or industry experience in robotics, computer vision, computer graphics, or machine learning
  • Strong programming skills in Python and/or C++ and deep experience with a major deep learning framework (e.g., PyTorch).
  • Experience applying research to robotic systems (e.g., using ROS 2, integrating models on physical hardware).
  • A proven track record of creativity and research excellence, demonstrated by publications in leading ML and Robotics conferences.
  • Deep expertise in one or more of the following areas: (1). 3D Scene Understanding: (e.g., NeRFs, 3D Gaussian Splatting, 3D reconstruction, geometric deep learning). (2). Generative Modeling: (e.g., Diffusion Models, VAEs, LLMs, Multimodal Models) applied to 3D or dynamic data. (3). Physics-Informed AI: (e.g., Differentiable simulation, Physics-based modeling, System identification).

Bonus Qualifications

  • Experience with large-scale model training, including distributed training techniques
  • Familiarity with MLOps workflows and tools (e.g., Docker, cloud computing) for large-scale experiments
  • Familiarity with causal representation learning or related techniques.

Why Join Us

  • We offer a unique environment for those who want to do foundational work with real-world impact, without the constraints of a product-driven roadmap.
  • You will have:
  • Intellectual Freedom: The latitude to pursue ambitious, long-term research goals in a culture that prioritizes scientific discovery
  • Unparalled Resources: Access to extensive GPU compute clusters, unique proprietary datasets, and a world-class robotics lab featuring a variety of commercial and in-house custom robotic platforms.
  • A Culture of Balance: We believe groundbreaking work happens when people have the time to think deeply. We offer a more relaxed, collaborative atmosphere with a genuine commitment to work-life balance.
  • A Full-Stack Team: You'll be surrounded by, and learn from, world-class experts across the entire robotics stack—from custom hardware design and embedded systems to ML engineering, computer vision, and AI theory.

We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other

Top Skills

Python,C++,Pytorch,Ros 2,Docker
HQ

RAI Institute Cambridge, Massachusetts, USA Office

145 Broadway, Cambridge, MA, United States, 02142

Similar Jobs

8 Minutes Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
80K-100K
Senior level
80K-100K
Senior level
Sales • Software • Travel
The Account Executive at FareHarbor will manage a book of business through the complete sales cycle, leveraging CRM tools while building relationships with clients to meet sales targets and provide tailored solutions.
8 Minutes Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
Senior level
Senior level
Fintech • Information Technology • Insurance • Software
The Senior IT Support Engineer will provide IT support, mentor team members, manage user technology security, resolve problems, and handle budget responsibilities.
Top Skills: BashFresh ServiceGoogle WorkspaceJamf MdmJIRAMicrosoft IntunePowershellPythonWindows 10
8 Minutes Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
Senior level
Senior level
Fintech • Information Technology • Insurance • Software
The Senior Underwriter will manage underwriting quality and profitability, analyze trends, develop product recommendations, and collaborate with internal and external teams for growth.
Top Skills: Data AnalysisInsurance TechnologyUnderwriting Software

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account