Visualizing Robot Intent for Object Handovers with Augmented Reality

03/06/2021
by   Rhys Newbury, et al.
0

Humans are very skillful in communicating their intent for when and where a handover would occur. On the other hand, even the state-of-the-art robotic implementations for handovers display a general lack of communication skills. We propose visualizing the internal state and intent of robots for Human-to-Robot Handovers using Augmented Reality. Specifically, we visualize 3D models of the object and the robotic gripper to communicate the robot's estimation of where the object is and the pose that the robot intends to grasp the object. We conduct a user study with 16 participants, in which each participant handed over a cube-shaped object to the robot 12 times. Results show that visualizing robot intent using augmented reality substantially improves the subjective experience of the users for handovers and decreases the time to transfer the object. Results also indicate that the benefits of augmented reality are still present even when the robot makes errors in localizing the object.

READ FULL TEXT

page 1

page 3

research
04/08/2021

Seeing Thru Walls: Visualizing Mobile Robots in Augmented Reality

We present an approach for visualizing mobile robots through an Augmente...
research
01/26/2018

A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction

Picking up objects requested by a human user is a common task in human-r...
research
09/03/2021

Communicating Inferred Goals with Passive Augmented Reality and Active Haptic Feedback

Robots learn as they interact with humans. Consider a human teleoperatin...
research
12/02/2019

Augmented Reality for Human-Swarm Interaction in a Swarm-Robotic Chemistry Simulation

We present a method to register individual members of a robotic swarm in...
research
11/18/2021

Semantic Interaction in Augmented Reality Environments for Microsoft HoloLens

Augmented Reality is a promising technique for human-machine interaction...
research
03/05/2023

An Avatar Robot Overlaid with the 3D Human Model of a Remote Operator

Although telepresence assistive robots have made significant progress, t...
research
12/10/2020

Adapting the Human: Leveraging Wearable Technology in HRI

Adhering to current HRI paradigms, all of the sensors, visualisation and...

Please sign up or login with your details

Forgot password? Click here to reset