Detection of social signals for recognizing engagement in human-robot interaction

09/29/2017
by   Divesh Lala, et al.
0

Detection of engagement during a conversation is an important function of human-robot interaction. The level of user engagement can influence the dialogue strategy of the robot. Our motivation in this work is to detect several behaviors which will be used as social signal inputs for a real-time engagement recognition model. These behaviors are nodding, laughter, verbal backchannels and eye gaze. We describe models of these behaviors which have been learned from a large corpus of human-robot interactions with the android robot ERICA. Input data to the models comes from a Kinect sensor and a microphone array. Using our engagement recognition model, we can achieve reasonable performance using the inputs from automatic social signal detection, compared to using manual annotation as input.

READ FULL TEXT
research
10/08/2021

Core Elements of Social Interaction for Constructive Human-Robot Interaction

We present a discovery-based, first version, explicit model of social in...
research
04/20/2020

On-the-fly Detection of User Engagement Decrease in Spontaneous Human-Robot Interaction, International Journal of Social Robotics, 2019

In this paper, we consider the detection of a decrease of engagement by ...
research
03/12/2015

Starting engagement detection towards a companion robot using multimodal features

Recognition of intentions is a subconscious cognitive process vital to h...
research
12/28/2022

Joint Engagement Classification using Video Augmentation Techniques for Multi-person Human-robot Interaction

Affect understanding capability is essential for social robots to autono...
research
06/06/2022

An Estimation Framework for Passerby Engagement Interacting with Social Robots

Social robots are expected to be a human labor support technology, and o...
research
01/13/2021

I Can See it in Your Eyes: Gaze as an Implicit Cue of Uncanniness and Task Performance in Repeated Interactions

Over the past years, extensive research has been dedicated to developing...
research
02/08/2023

Communicative Robot Signals: Presenting a New Typology for Human-Robot Interaction

We present a new typology for classifying signals from robots when they ...

Please sign up or login with your details

Forgot password? Click here to reset