Artificial Emotional Intelligence in Socially Assistive Robots for Older Adults: A Pilot Study

01/26/2022
by   Hojjat Abdollahi, et al.
0

This paper presents our recent research on integrating artificial emotional intelligence in a social robot (Ryan) and studies the robot's effectiveness in engaging older adults. Ryan is a socially assistive robot designed to provide companionship for older adults with depression and dementia through conversation. We used two versions of Ryan for our study, empathic and non-empathic. The empathic Ryan utilizes a multimodal emotion recognition algorithm and a multimodal emotion expression system. Using different input modalities for emotion, i.e. facial expression and speech sentiment, the empathic Ryan detects users' emotional state and utilizes an affective dialogue manager to generate a response. On the other hand, the non-empathic Ryan lacks facial expression and uses scripted dialogues that do not factor in the users' emotional state. We studied these two versions of Ryan with 10 older adults living in a senior care facility. The statistically significant improvement in the users' reported face-scale mood measurement indicates an overall positive effect from the interaction with both the empathic and non-empathic versions of Ryan. However, the number of spoken words measurement and the exit survey analysis suggest that the users perceive the empathic Ryan as more engaging and likable.

READ FULL TEXT

page 1

page 4

page 7

page 9

page 13

research
06/08/2017

Sympathy Begins with a Smile, Intelligence Begins with a Word: Use of Multimodal Features in Spoken Human-Robot Interaction

Recognition of social signals, from human facial expressions or prosody ...
research
09/25/2017

Towards Indonesian Speech-Emotion Automatic Recognition (I-SpEAR)

Even though speech-emotion recognition (SER) has been receiving much att...
research
12/23/2021

Your Face Mirrors Your Deepest Beliefs-Predicting Personality and Morals through Facial Emotion Recognition

Can we really "read the mind in the eyes"? Moreover, can AI assist us in...
research
03/16/2021

Leveraging Recent Advances in Deep Learning for Audio-Visual Emotion Recognition

Emotional expressions are the behaviors that communicate our emotional s...
research
12/10/2019

Context-Dependent Models for Predicting and Characterizing Facial Expressiveness

In recent years, extensive research has emerged in affective computing o...
research
09/14/2019

Delivering Cognitive Behavioral Therapy Using A Conversational SocialRobot

Social robots are becoming an integrated part of our daily life due to t...
research
09/18/2020

Learning Emotional-Blinded Face Representations

We propose two face representations that are blind to facial expressions...

Please sign up or login with your details

Forgot password? Click here to reset