A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction

01/26/2018
by   Elena Sibirtseva, et al.
0

Picking up objects requested by a human user is a common task in human-robot interaction. When multiple objects match the user's verbal description, the robot needs to clarify which object the user is referring to before executing the action. Previous research has focused on perceiving user's multimodal behaviour to complement verbal commands or minimising the number of follow up questions to reduce task time. In this paper, we propose a system for reference disambiguation based on visualisation and compare three methods to disambiguate natural language instructions. In a controlled experiment with a YuMi robot, we investigated real-time augmentations of the workspace in three conditions -- mixed reality, augmented reality, and a monitor as the baseline -- using objective measures such as time and accuracy, and subjective measures like engagement, immersion, and display interference. Significant differences were found in accuracy and engagement between the conditions, but no differences were found in task time. Despite the higher error rates in the mixed reality condition, participants found that modality more engaging than the other two, but overall showed preference for the augmented reality condition over the monitor and mixed reality conditions.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 4

03/06/2021

Visualizing Robot Intent for Object Handovers with Augmented Reality

Humans are very skillful in communicating their intent for when and wher...
01/16/2018

Excuse me! Perception of Abrupt Direction Changes Using Body Cues and Paths on Mixed Reality Avatars

We evaluate two methods of signalling abrupt direction changes of a robo...
09/13/2019

Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

Human-robot teaming offers great potential because of the opportunities ...
04/12/2021

Virtual Barriers in Augmented Reality for Safe and Effective Human-Robot Cooperation in Manufacturing

Safety is a fundamental requirement in any human-robot collaboration sce...
12/20/2020

Enabling Tangible Interaction through Detection and Augmentation of Everyday Objects

Digital interaction with everyday objects has become popular since the p...
11/18/2021

Semantic Interaction in Augmented Reality Environments for Microsoft HoloLens

Augmented Reality is a promising technique for human-machine interaction...
02/04/2019

Exploring Temporal Dependencies in Multimodal Referring Expressions with Mixed Reality

In collaborative tasks, people rely both on verbal and non-verbal cues s...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.