An Ensemble Approach for Facial Expression Analysis in Video

03/24/2022
by   Hong-Hai Nguyen, et al.
0

Human emotions recognization contributes to the development of human-computer interaction. The machines understanding human emotions in the real world will significantly contribute to life in the future. This paper will introduce the Affective Behavior Analysis in-the-wild (ABAW3) 2022 challenge. The paper focuses on solving the problem of the valence-arousal estimation and action unit detection. For valence-arousal estimation, we conducted two stages: creating new features from multimodel and temporal learning to predict valence-arousal. First, we make new features; the Gated Recurrent Unit (GRU) and Transformer are combined using a Regular Networks (RegNet) feature, which is extracted from the image. The next step is the GRU combined with Local Attention to predict valence-arousal. The Concordance Correlation Coefficient (CCC) was used to evaluate the model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/23/2022

Transformer-based Multimodal Information Fusion for Facial Expression Analysis

Facial expression analysis has been a crucial research problem in the co...
research
07/07/2021

Multi-modal Affect Analysis using standardized data within subjects in the Wild

Human affective recognition is an important factor in human-computer int...
research
08/18/2023

LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis

Facial expression analysis is an important tool for human-computer inter...
research
03/15/2023

Local Region Perception and Relationship Learning Combined with Feature Fusion for Facial Action Unit Detection

Human affective behavior analysis plays a vital role in human-computer i...
research
08/02/2018

Constructionist Steps Towards an Autonomously Empathetic System

Prior efforts to create an autonomous computer system capable of predict...
research
07/03/2022

Are 3D Face Shapes Expressive Enough for Recognising Continuous Emotions and Action Unit Intensities?

Recognising continuous emotions and action unit (AU) intensities from fa...
research
05/23/2022

Computational Storytelling and Emotions: A Survey

Storytelling has always been vital for human nature. From ancient times,...

Please sign up or login with your details

Forgot password? Click here to reset