Augmented-Reality-Based Visualization of Navigation Data of Mobile Robots on the Microsoft Hololens – Possibilities and Limitations

12/27/2019
by   Linh Kästner, et al.
0

The demand for mobile robots has rapidly increased in recent years due to the flexibility and high variety of application fields comparing to static robots. To deal with complex tasks such as navigation, they work with high amounts of different sensor data making it difficult to operate with for non-experts. To enhance user understanding and human robot interaction, we propose an approach to visualize the navigation stack within a cutting edge 3D Augmented Reality device – the Microsoft Hololens. Therefore, relevant navigation stack data including laser scan, environment map and path planing data are visualized in 3D within the head mounted device. Based on that prototype, we evaluate the Hololens in terms of computational capabilities and limitations for dealing with huge amount of real-time data. Results show that the Hololens is capable of a proper visualization of huge amounts of sensor data. We demonstrate a proper visualization of navigation stack data in 3D within the Hololens. However, there are limitations when transferring and displaying different kinds of data simultaneously.

READ FULL TEXT

page 1

page 4

research
12/27/2019

A 3D-Deep-Learning-based Augmented Reality Calibration Method for Robotic Environments using Depth Sensor Data

Augmented Reality and mobile robots are gaining much attention within in...
research
06/12/2022

Imagination-augmented Navigation Based on 2D Laser Sensor Observations

Autonomous navigation of mobile robots is an essential task for various ...
research
11/13/2022

Learning Visualization Policies of Augmented Reality for Human-Robot Collaboration

In human-robot collaboration domains, augmented reality (AR) technologie...
research
06/22/2023

Investigating the Usability of Collaborative Robot control through Hands-Free Operation using Eye gaze and Augmented Reality

This paper proposes a novel operation for controlling a mobile robot usi...
research
05/31/2016

Robust Deep-Learning-Based Road-Prediction for Augmented Reality Navigation Systems

This paper proposes an approach that predicts the road course from camer...
research
12/26/2022

Development of an automatic 3D human head scanning-printing system

Three-dimensional (3D) technologies have been developing rapidly recent ...
research
10/05/2021

Reducing Gaze Distraction for Real-time Vibration Monitoring Using Augmented Reality

Operators want to maintain awareness of the structure being tested while...

Please sign up or login with your details

Forgot password? Click here to reset