Using Social Cues to Recognize Task Failures for HRI: A Review of Current Research and Future Directions

01/27/2023
by   Alexandra Bremers, et al.
0

Robots that carry out tasks and interact in complex environments will inevitably commit errors. Error detection is thus an important ability for robots to master, to work in an efficient and productive way. People leverage social cues from others around them to recognize and repair their own mistakes. With advances in computing and AI, it is increasingly possible for robots to achieve a similar error detection capability. In this work, we review current literature around the topic of how social cues can be used to recognize task failures for human-robot interaction (HRI). This literature review unites insights from behavioral science, human-robot interaction, and machine learning, to focus on three areas: 1) social cues for error detection (from behavioral science), 2) recognizing task failures in robots (from HRI), and 3) approaches for autonomous detection of HRI task failures based on social cues (from machine learning). We propose a taxonomy of error detection based on self-awareness and social feedback. Finally, we leave recommendations for HRI researchers and practitioners interested in developing robots that detect (physical) task errors using social cues from bystanders.

READ FULL TEXT
research
04/22/2023

Nonverbal Cues in Human-Robot Interaction: A Communication Studies Perspective

Communication between people is characterized by a broad range of nonver...
research
08/31/2023

Developing Social Robots with Empathetic Non-Verbal Cues Using Large Language Models

We propose augmenting the empathetic capacities of social robots by inte...
research
03/08/2023

The Bystander Affect Detection (BAD) Dataset for Failure Detection in HRI

For a robot to repair its own error, it must first know it has made a mi...
research
08/17/2020

REFORM: Recognizing F-formations for Social Robots

Recognizing and understanding conversational groups, or F-formations, is...
research
09/09/2019

Recognizing Human Internal States: A Conceptor-Based Approach

The past few decades has seen increased interest in the application of s...
research
07/20/2022

Face-to-Face Co-Located Human-Human Social Interaction Analysis using Nonverbal Cues: A Survey

This work presents a systematic review of recent efforts (since 2010) ai...
research
08/01/2018

Robots Racialized in the Likeness of Marginalized Social Identities are Subject to Greater Dehumanization than those racialized as White

The emergence and spread of humanlike robots into increasingly public do...

Please sign up or login with your details

Forgot password? Click here to reset