Modeling User Empathy Elicited by a Robot Storyteller

07/29/2021
by   Leena Mathur, et al.
0

Virtual and robotic agents capable of perceiving human empathy have the potential to participate in engaging and meaningful human-machine interactions that support human well-being. Prior research in computational empathy has focused on designing empathic agents that use verbal and nonverbal behaviors to simulate empathy and attempt to elicit empathic responses from humans. The challenge of developing agents with the ability to automatically perceive elicited empathy in humans remains largely unexplored. Our paper presents the first approach to modeling user empathy elicited during interactions with a robotic agent. We collected a new dataset from the novel interaction context of participants listening to a robot storyteller (46 participants, 6.9 hours of video). After each storytelling interaction, participants answered a questionnaire that assessed their level of elicited empathy during the interaction with the robot. We conducted experiments with 8 classical machine learning models and 2 deep learning models (long short-term memory networks and temporal convolutional networks) to detect empathy by leveraging patterns in participants' visual behaviors while they were listening to the robot storyteller. Our highest-performing approach, based on XGBoost, achieved an accuracy of 69 insights regarding modeling approaches and visual features for automated empathy detection. Our research informs and motivates future development of empathy perception models that can be leveraged by virtual and robotic agents during human-machine interactions.

READ FULL TEXT

page 1

page 3

research
05/24/2022

Influence of perspective taking through robotic virtual agents on prosocial behavior

Perspective taking, which allows people to imagine another's thinking an...
research
09/14/2019

Building Second-Order Mental Models for Human-Robot Interaction

The mental models that humans form of other agents—encapsulating human b...
research
06/09/2020

Creating a Robot Coach for Mindfulness and Wellbeing: A Longitudinal Study

Social robots are starting to become incorporated into daily lives by as...
research
02/25/2012

Interaction Histories and Short Term Memory: Enactive Development of Turn-taking Behaviors in a Childlike Humanoid Robot

In this article, an enactive architecture is described that allows a hum...
research
02/04/2019

When Exceptions are the Norm: Exploring the Role of Consent in HRI

HRI researchers have made major strides in developing robotic architectu...
research
10/28/2020

SFU-Store-Nav: A Multimodal Dataset for Indoor Human Navigation

This article describes a dataset collected in a set of experiments that ...
research
04/19/2020

Imperatives for Virtual Humans

Seemingly since the inception of virtual humans, there has been an effor...

Please sign up or login with your details

Forgot password? Click here to reset