Mixed Reality Bridge

See your robot’s world alongside your own. Mixed Reality Bridge connects mixed reality devices such as Quest 3 and Android XR to ROS 2-based robots, bringing robot control, maps, and overlays into a shared spatial context.

The aim is to align the device’s and robot’s maps so overlays sit in the right place when you work alongside the robot. For remote operation, the bridge uses Decentralized Robotics transports to connect the operator and robot for teleoperation.

Status: On the roadmap. The capabilities below are design goals, not confirmed specifications, and may change as development progresses.

Design goals

  • Connect mixed reality devices such as Quest 3 and Android XR to ROS 2-based robots.
  • Control robots from a mixed reality interface.
  • Spatially align device and robot maps, with overlays colocated in the shared environment.
  • Use Decentralized Robotics transports for remote teleoperation.

Help build what’s next

Want to work alongside a robot with its map in view—or operate it from farther away? Sponsorship helps fund development, robotics hardware, and the experiments behind the roadmap. Contributions support the overall Ranch Hand Robotics effort, not a Mixed Reality Bridge preorder or a promised release date.

Become a sponsor on GitHub

Explore the other projects or follow the builds on YouTube.