Learning Visualization Policies of Augmented Reality for Human-Robot Collaboration

11/13/2022
by   Kishan Chandan, et al.
0

In human-robot collaboration domains, augmented reality (AR) technologies have enabled people to visualize the state of robots. Current AR-based visualization policies are designed manually, which requires a lot of human efforts and domain knowledge. When too little information is visualized, human users find the AR interface not useful; when too much information is visualized, they find it difficult to process the visualized information. In this paper, we develop a framework, called VARIL, that enables AR agents to learn visualization policies (what to visualize, when, and how) from demonstrations. We created a Unity-based platform for simulating warehouse environments where human-robot teammates collaborate on delivery tasks. We have collected a dataset that includes demonstrations of visualizing robots' current and planned behaviors. Results from experiments with real human participants show that, compared with competitive baselines from the literature, our learned visualization strategies significantly increase the efficiency of human-robot teams, while reducing the distraction level of human users. VARIL has been demonstrated in a built-in-lab mock warehouse.

READ FULL TEXT

page 2

page 6

page 7

page 13

page 14

research
09/24/2019

Negotiation-based Human-Robot Collaboration via Augmented Reality

Effective human-robot collaboration (HRC) requires extensive communicati...
research
10/29/2021

ARviz – An Augmented Reality-enabled Visualization Platform for ROS Applications

Current robot interfaces such as teach pendants and 2D screen displays u...
research
05/08/2023

ARDIE: AR, Dialogue, and Eye Gaze Policies for Human-Robot Collaboration

Human-robot collaboration (HRC) has become increasingly relevant in indu...
research
12/27/2019

Augmented-Reality-Based Visualization of Navigation Data of Mobile Robots on the Microsoft Hololens – Possibilities and Limitations

The demand for mobile robots has rapidly increased in recent years due t...
research
03/09/2023

Enhancing Human-robot Collaboration by Exploring Intuitive Augmented Reality Design Representations

As the use of Augmented Reality (AR) to enhance interactions between hum...
research
04/26/2023

Multimodal Grounding for Embodied AI via Augmented Reality Headsets for Natural Language Driven Task Planning

Recent advances in generative modeling have spurred a resurgence in the ...
research
03/23/2023

Feedback and Control of Dynamics and Robotics using Augmented Reality

Human-machine interaction (HMI) and human-robot interaction (HRI) can as...

Please sign up or login with your details

Forgot password? Click here to reset