DeepAI AI Chat
Log In Sign Up

Modeling Human Response to Robot Errors for Timely Error Detection

by   Maia Stiber, et al.
Johns Hopkins University

In human-robot collaboration, robot errors are inevitable – damaging user trust, willingness to work together, and task performance. Prior work has shown that people naturally respond to robot errors socially and that in social interactions it is possible to use human responses to detect errors. However, there is little exploration in the domain of non-social, physical human-robot collaboration such as assembly and tool retrieval. In this work, we investigate how people's organic, social responses to robot errors may be used to enable timely automatic detection of errors in physical human-robot interactions. We conducted a data collection study to obtain facial responses to train a real-time detection algorithm and a case study to explore the generalizability of our method with different task settings and errors. Our results show that natural social responses are effective signals for timely detection and localization of robot errors even in non-social contexts and that our method is robust across a variety of task contexts, robot errors, and user responses. This work contributes to robust error detection without detailed task specifications.


page 1

page 3

page 4

page 5

page 6

page 7


Crafting with a Robot Assistant: Use Social Cues to Inform Adaptive Handovers in Human-Robot Collaboration

We study human-robot handovers in a naturalistic collaboration scenario,...

The Bystander Affect Detection (BAD) Dataset for Failure Detection in HRI

For a robot to repair its own error, it must first know it has made a mi...

Detecting Low Rapport During Natural Interactions in Small Groups from Non-Verbal Behaviour

Rapport, the close and harmonious relationship in which interaction part...

Learning and Blending Robot Hugging Behaviors in Time and Space

We introduce an imitation learning-based physical human-robot interactio...

Audience Response Prediction from Textual Context

Humans' perception system closely monitors audio-visual cues during mult...

Exploring Implicit Human Responses to Robot Mistakes in a Learning from Demonstration Task

As robots enter human environments, they will be expected to accomplish ...