SimNav-XR: an extended reality platform for mobile robot simulation using ROS2 and Unity3D.
Options
BORIS DOI
Publisher DOI
PubMed ID
41789161
Description
Introduction
This paper presents SimNav-XR, an extended reality platform that integrates XR technologies with modern robotics frameworks to support mobile robot simulation and development.
Methods
By connecting ROS2's communication infrastructure with Unity3D's rendering and XR capabilities through the ROS-TCP-Connector package, SimNav-XR provides a practical bridge between robotics middleware and game engine environments for visualization and testing. The platform implements components for physics-based robot modeling, LiDAR and IMU sensor simulation, environmental interaction dynamics, and XR interfaces supporting both Virtual Reality (VR) and Mixed Reality (MR) modes. These capabilities create interactive environments where developers can visualize and control simulated robots through immersive interfaces using the Meta Quest 3 headset with controller-based input.
Results
Experimental evaluations using established platforms (Turtlebot3 and ROSbotXL) demonstrate the framework's capabilities across virtual testing scenarios, showing successful autonomous navigation with obstacle avoidance and simultaneous localization and mapping (SLAM). The VR mode provides fully immersive virtual environments for development and testing, while the MR mode uses passthrough cameras to overlay virtual robots onto real-world surfaces via plane detection.
Discussion
XR visualization techniques provide insights into robot sensor data and navigation behavior, supporting robotics development and education through accessible simulation environments.
This paper presents SimNav-XR, an extended reality platform that integrates XR technologies with modern robotics frameworks to support mobile robot simulation and development.
Methods
By connecting ROS2's communication infrastructure with Unity3D's rendering and XR capabilities through the ROS-TCP-Connector package, SimNav-XR provides a practical bridge between robotics middleware and game engine environments for visualization and testing. The platform implements components for physics-based robot modeling, LiDAR and IMU sensor simulation, environmental interaction dynamics, and XR interfaces supporting both Virtual Reality (VR) and Mixed Reality (MR) modes. These capabilities create interactive environments where developers can visualize and control simulated robots through immersive interfaces using the Meta Quest 3 headset with controller-based input.
Results
Experimental evaluations using established platforms (Turtlebot3 and ROSbotXL) demonstrate the framework's capabilities across virtual testing scenarios, showing successful autonomous navigation with obstacle avoidance and simultaneous localization and mapping (SLAM). The VR mode provides fully immersive virtual environments for development and testing, while the MR mode uses passthrough cameras to overlay virtual robots onto real-world surfaces via plane detection.
Discussion
XR visualization techniques provide insights into robot sensor data and navigation behavior, supporting robotics development and education through accessible simulation environments.
Date of Publication
2026
Publication Type
Article
Keyword(s)
ROS2
•
Unity3D
•
autonomous navigation
•
extended reality
•
mixed reality
•
mobile robots
•
robotics simulation
•
virtual reality
Language(s)
en
Contributor(s)
Shetty, Sujala Deepak | |
Kalaichelvi, V | |
Karthikeyan, R |
Additional Credits
Series
Frontiers in Robotics and AI
Publisher
Frontiers Media
ISSN
2296-9144
Access(Rights)
open.access