On-the-fly Detection of User Engagement Decrease in Spontaneous Human-Robot Interaction, International Journal of Social Robotics, 2019

by   Atef Ben Youssef, et al.

In this paper, we consider the detection of a decrease of engagement by users spontaneously interacting with a socially assistive robot in a public space. We first describe the UE-HRI dataset that collects spontaneous Human-Robot Interactions following the guidelines provided by the Affective Computing research community to collect data "in-the-wild". We then analyze the users' behaviors, focusing on proxemics, gaze, head motion, facial expressions and speech during interactions with the robot. Finally, we investigate the use of deep learning techniques (Recurrent and Deep Neural Networks) to detect user engagement decrease in realtime. The results of this work highlight, in particular, the relevance of taking into account the temporal dynamics of a user's behavior. Allowing 1 to 2 seconds as buffer delay improves the performance of taking a decision on user engagement.



There are no comments yet.


page 4

page 12


Detection of social signals for recognizing engagement in human-robot interaction

Detection of engagement during a conversation is an important function o...

Core Elements of Social Interaction for Constructive Human-Robot Interaction

We present a discovery-based, first version, explicit model of social in...

Starting engagement detection towards a companion robot using multimodal features

Recognition of intentions is a subconscious cognitive process vital to h...

Speech Driven Backchannel Generation using Deep Q-Network for Enhancing Engagement in Human-Robot Interaction

We present a novel method for training a social robot to generate backch...

Learning on the Job: Long-Term Behavioural Adaptation in Human-Robot Interactions

In this work, we propose a framework for allowing autonomous robots depl...

Are you still with me? Continuous Engagement Assessment from a Robot's Point of View

Continuously measuring the engagement of users with a robot in a Human-R...

A ROS Architecture for Personalised HRI with a Bartender Social Robot

BRILLO (Bartending Robot for Interactive Long-Lasting Operations) projec...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.