Hybrid Models for Facial Emotion Recognition in Children

08/24/2023
by   Rafael Zimmer, et al.
0

This paper focuses on the use of emotion recognition techniques to assist psychologists in performing children's therapy through remotely robot operated sessions. In the field of psychology, the use of agent-mediated therapy is growing increasingly given recent advances in robotics and computer science. Specifically, the use of Embodied Conversational Agents (ECA) as an intermediary tool can help professionals connect with children who face social challenges such as Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorder (ASD) or even who are physically unavailable due to being in regions of armed conflict, natural disasters, or other circumstances. In this context, emotion recognition represents an important feedback for the psychotherapist. In this article, we initially present the result of a bibliographical research associated with emotion recognition in children. This research revealed an initial overview on algorithms and datasets widely used by the community. Then, based on the analysis carried out on the results of the bibliographical research, we used the technique of dense optical flow features to improve the ability of identifying emotions in children in uncontrolled environments. From the output of a hybrid model of Convolutional Neural Network, two intermediary features are fused before being processed by a final classifier. The proposed architecture was called HybridCNNFusion. Finally, we present the initial results achieved in the recognition of children's emotions using a dataset of Brazilian children.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2022

Adults as Augmentations for Children in Facial Emotion Recognition with Contrastive Learning

Emotion recognition in children can help the early identification of, an...
research
05/08/2019

Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advances

Emotion is intrinsic to humans and consequently emotion understanding is...
research
08/22/2021

Training and Profiling a Pediatric Emotion Recognition Classifier on Mobile Devices

Implementing automated emotion recognition on mobile devices could provi...
research
05/09/2022

A Music-Therapy Robotic Platform for Children with Autism: A Pilot Study

Children with Autism Spectrum Disorder (ASD) experience deficits in verb...
research
06/17/2021

A Two-stage Multi-modal Affect Analysis Framework for Children with Autism Spectrum Disorder

Autism spectrum disorder (ASD) is a developmental disorder that influenc...
research
07/24/2023

Introducing CALMED: Multimodal Annotated Dataset for Emotion Detection in Children with Autism

Automatic Emotion Detection (ED) aims to build systems to identify users...
research
10/27/2022

Handwashing Action Detection System for an Autonomous Social Robot

Young children are at an increased risk of contracting contagious diseas...

Please sign up or login with your details

Forgot password? Click here to reset