Spatial and Temporal Networks for Facial Expression Recognition in the Wild Videos

07/12/2021
by   Shuyi Mao, et al.
0

The paper describes our proposed methodology for the seven basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2021. In this task, facial expression recognition (FER) methods aim to classify the correct expression category from a diverse background, but there are several challenges. First, to adapt the model to in-the-wild scenarios, we use the knowledge from pre-trained large-scale face recognition data. Second, we propose an ensemble model with a convolution neural network (CNN), a CNN-recurrent neural network (CNN-RNN), and a CNN-Transformer (CNN-Transformer), to incorporate both spatial and temporal information. Our ensemble model achieved F1 as 0.4133, accuracy as 0.6216 and final metric as 0.4821 on the validation set.

READ FULL TEXT

page 1

page 2

page 3

research
10/03/2020

Deep Convolutional Neural Network Based Facial Expression Recognition in the Wild

This paper describes the proposed methodology, data used and the results...
research
07/20/2022

AU-Supervised Convolutional Vision Transformers for Synthetic Facial Expression Recognition

The paper describes our proposed methodology for the six basic expressio...
research
04/05/2022

Vision Transformer Equipped with Neural Resizer on Facial Expression Recognition Task

When it comes to wild conditions, Facial Expression Recognition is often...
research
08/25/2019

Multi-Channel Neural Network for Assessing Neonatal Pain from Videos

Neonates do not have the ability to either articulate pain or communicat...
research
03/19/2023

TempT: Temporal consistency for Test-time adaptation

In this technical report, we introduce TempT, a novel method for test ti...
research
01/31/2020

Lossless Attention in Convolutional Networks for Facial Expression Recognition in the Wild

Unlike the constraint frontal face condition, faces in the wild have var...
research
03/24/2022

Expression Classification using Concatenation of Deep Neural Network for the 3rd ABAW3 Competition

For computers to recognize human emotions, expression classification is ...

Please sign up or login with your details

Forgot password? Click here to reset