Mixed Reality as Communication Medium for Human-Robot Collaboration

06/30/2022
by   Simone Macciò, et al.
0

Humans engaged in collaborative activities are naturally able to convey their intentions to teammates through multi-modal communication, which is made up of explicit and implicit cues. Similarly, a more natural form of human-robot collaboration may be achieved by enabling robots to convey their intentions to human teammates via multiple communication channels. In this paper, we postulate that a better communication may take place should collaborative robots be able to anticipate their movements to human teammates in an intuitive way. In order to support such a claim, we propose a robot system's architecture through which robots can communicate planned motions to human teammates leveraging a Mixed Reality interface powered by modern head-mounted displays. Specifically, the robot's hologram, which is superimposed to the real robot in the human teammate's point of view, shows the robot's future movements, allowing the human to understand them in advance, and possibly react to them in an appropriate way. We conduct a preliminary user study to evaluate the effectiveness of the proposed anticipatory visualization during a complex collaborative task. The experimental results suggest that an improved and more natural collaboration can be achieved by employing this anticipatory communication mode.

READ FULL TEXT

page 2

page 5

research
04/25/2023

Improved Trust in Human-Robot Collaboration with ChatGPT

Human robot collaboration is becoming increasingly important as robots b...
research
08/11/2017

Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays

Efficient motion intent communication is necessary for safe and collabor...
research
03/08/2021

Let's be friends! A rapport-building 3D embodied conversational agent for the Human Support Robot

Partial subtle mirroring of nonverbal behaviors during conversations (al...
research
02/04/2019

Exploring Temporal Dependencies in Multimodal Referring Expressions with Mixed Reality

In collaborative tasks, people rely both on verbal and non-verbal cues s...
research
12/21/2020

Analysis of Safe Ultrawideband Human-Robot Communication in Automated Collaborative Warehouse

The paper presents the propagation analysis of ultrawideband Gaussian si...
research
07/29/2018

Spiking Neural Networks for Early Prediction in Human Robot Collaboration

This paper introduces the Turn-Taking Spiking Neural Network (TTSNet), w...

Please sign up or login with your details

Forgot password? Click here to reset