Seeing Thru Walls: Visualizing Mobile Robots in Augmented Reality

04/08/2021
by   Morris Gu, et al.
0

We present an approach for visualizing mobile robots through an Augmented Reality headset when there is no line-of-sight visibility between the robot and the human. Three elements are visualized in Augmented Reality: 1) Robot's 3D model to indicate its position, 2) An arrow emanating from the robot to indicate its planned movement direction, and 3) A 2D grid to represent the ground plane. We conduct a user study with 18 participants, in which each participant are asked to retrieve objects, one at a time, from stations at the two sides of a T-junction at the end of a hallway where a mobile robot is roaming. The results show that visualizations improved the perceived safety and efficiency of the task and led to participants being more comfortable with the robot within their personal spaces. Furthermore, visualizing the motion intent in addition to the robot model was found to be more effective than visualizing the robot model alone. The proposed system can improve the safety of automated warehouses by increasing the visibility and predictability of robots.

READ FULL TEXT

page 1

page 4

research
03/06/2021

Visualizing Robot Intent for Object Handovers with Augmented Reality

Humans are very skillful in communicating their intent for when and wher...
research
07/05/2021

Online and Offline Robot Programming via Augmented Reality Workspaces

Robot programming methods for industrial robots are time consuming and o...
research
03/03/2020

Augmented Reality on the Large Scene Based on a Markerless Registration Framework

In this paper, a mobile camera positioning method based on forward and i...
research
05/13/2022

Augmented Reality Appendages for Robots: Design Considerations and Recommendations for Maximizing Social and Functional Perception

In order to address the limitations of gestural capabilities in physical...
research
09/14/2023

Towards Safer Robot-Assisted Surgery: A Markerless Augmented Reality Framework

Robot-assisted surgery is rapidly developing in the medical field, and t...
research
11/21/2019

Using Socially Expressive Mixed Reality Arms for Enhancing Low-Expressivity Robots

Expressivity–the use of multiple modalities to convey internal state and...
research
08/13/2019

General Hand Guidance Framework using Microsoft HoloLens

Hand guidance emerged from the safety requirements for collaborative rob...

Please sign up or login with your details

Forgot password? Click here to reset