Toyota Research Institute
VR Teleoperation UI/UX Engineer, Large Behavior Models
Be an Early Applicant
Design and implement intuitive VR UI/UX for robotic teleoperation, build immersive experiences, conduct user research, and develop front-end engineering for seamless integration.
At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this progressive shift in mobility, we’ve built a world-class team in Automated Driving, Energy & Materials, Human-Centered AI, Human Interactive Driving, Large Behavior Models, and Robotics.
The Mission
Make general-purpose robots a reality.
The Challenge
We envision a future where robots assist with household chores and cooking, aid the older population in maintaining their independence, and enable people to spend more time on the activities they enjoy most. To achieve this, robots need to be able to operate reliably in messy, unstructured environments. Our mission is to answer the question “What will it take to create truly general-purpose robots that can accomplish a wide variety of tasks in settings like human homes with minimal human supervision?”. We believe that the answer lies in cultivating large-scale datasets of physical interaction from a variety of sources and building on the latest advances in machine learning to learn general-purpose robot behaviors from this data.
Robotics
The mission of TRI Robotics is to invent and prove new robotic capabilities required to enable home robots to solve the challenges faced by an aging society. As part of that mission, we are developing a sophisticated suite of open source robotics software called Drake (https://drake.mit.edu (https://drake.mit.edu/)), for use in our internal robotics projects and the wider community of advanced robotics researchers.
The Team
Join Toyota Research Institute’s LBM-C division to change the world by creating and shipping useful general-purpose AI-driven robots. Lead the teleoperation experience and turn pioneering R&D into real-world products that empower human-robot collaboration.
The Opportunity
As a VR Teleoperation UI/UX Engineer, you'll be instrumental in designing and implementing the user interface and experience for our groundbreaking VR teleoperation system. Your work will enable intuitive and immersive control of dexterous humanoid robots, transforming live camera and sensor feeds into low-latency, natural control interfaces. You will be responsible for the end-to-end user-facing pipeline, ensuring remote operators can fully use our robots' physical capabilities with ease and precision.
Responsibilities
- Design and Implement VR UI/UX: Create and refine intuitive user interfaces, control schemes (controllers, hand-tracking, gestures), and interactive elements within the VR environment specifically for robotic teleoperation.
- Develop Immersive Experiences: Build VR/XR systems that provide high situational awareness and intuitive control, minimizing operator fatigue during extended teleoperation sessions.
- User Research & Iteration: Conduct user research, gather feedback from operators, and rapidly iterate on design and implementation to optimize the teleoperation experience.
- Front-End Engineering: Develop robust and performant front-end code for the VR application, ensuring seamless integration with real-time data streams and robot command relays.
- Collaborate Cross-Functionally: Partner closely with hardware, AI, robot control, and deployment teams to ensure the UI/UX aligns with system capabilities and overall product goals.
Qualifications
- VR/XR UI/UX Design & Implementation: 5+ years of confirmed experience designing, prototyping, and shipping user interfaces and experiences for immersive experiences (VR or XR video games preferred), with a strong portfolio showcasing your work.
- Front-End Development Expertise: Shown ability to build efficient, reusable, and performance-critical front-end systems, ideally with experience in real-time graphics and data visualization.
- Game Design Principles (Applied to UI): Understanding of game design principles related to user feedback, immersion, and intuitive interaction
- User-Centered Design: A strong commitment to user-centered design principles, with experience conducting user testing and incorporating feedback into product development.
- Collaborative Approach: Passion for robotics and ability to work closely alongside hardware and software teams to deliver high-quality user experiences.
Bonus Qualifications
- Game Engine Proficiency: Strong proficiency in Unity or Unreal Engine for VR development.
- Haptics & Spatial Audio: Familiarity with integrating haptic feedback systems and spatial audio to improve immersion and situational awareness.
- Real-Time Data Pipelines: Experience with real-time data processing and rendering pipelines.
- Robotics Experience: Prior experience with robotic systems or teleoperation interfaces.
Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and/or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.
TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant’s race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records for employment.
Top Skills
Unity
Unreal Engine
Toyota Research Institute Cambridge, Massachusetts, USA Office
One Kendall Square, Building 600, Suite 6-501, Cambridge, MA, United States, 02139
Similar Jobs
Machine Learning • Security • Software • Analytics • Defense
As a Senior Embedded Software Engineer, you will develop software applications, ensure quality through testing, integrate components, and communicate technical designs within a multidisciplinary team, focusing on embedded systems and cybersecurity.
Top Skills:
BashCC++DockerGccGitGitlabLlvmPythonQemuSubversionTcp/Ip
Machine Learning • Security • Software • Analytics • Defense
The Cyber Principal Investigator will lead a team to create innovative cyber solutions, technical marketing, and proposal writing, impacting national security.
Top Skills:
C/C++MatlabPython
Food • Gaming • Hospitality
Responsible for the development, design, and integration of hardware and software for interactive gaming experiences. Collaborate with teams to ensure successful implementation of systems, optimize performance, and provide mentorship.
Top Skills:
AnsibleArduinoCircleCIDjango Rest FrameworkDmxGitLidarPlcsPythonSacn Lighting Controls
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
