DeepAI AI Chat
Log In Sign Up

Exploiting Emotional Dependencies with Graph Convolutional Networks for Facial Expression Recognition

by   Panagiotis Antoniadis, et al.

Over the past few years, deep learning methods have shown remarkable results in many face-related tasks including automatic facial expression recognition (FER) in-the-wild. Meanwhile, numerous models describing the human emotional states have been proposed by the psychology community. However, we have no clear evidence as to which representation is more appropriate and the majority of FER systems use either the categorical or the dimensional model of affect. Inspired by recent work in multi-label classification, this paper proposes a novel multi-task learning (MTL) framework that exploits the dependencies between these two models using a Graph Convolutional Network (GCN) to recognize facial expressions in-the-wild. Specifically, a shared feature representation is learned for both discrete and continuous recognition in a MTL setting. Moreover, the facial expression classifiers and the valence-arousal regressors are learned through a GCN that explicitly captures the dependencies between them. To evaluate the performance of our method under real-world conditions we train our models on AffectNet dataset. The results of our experiments show that our method outperforms the current state-of-the-art methods on discrete FER.


page 3

page 6

page 7

page 9


Facial Expression Restoration Based on Improved Graph Convolutional Networks

Facial expression analysis in the wild is challenging when the facial im...

Video-based Facial Expression Recognition using Graph Convolutional Networks

Facial expression recognition (FER), aiming to classify the expression p...

Face-GCN: A Graph Convolutional Network for 3D Dynamic Face Identification/Recognition

Face identification/recognition has significantly advanced over the past...

TAA-GCN: A Temporally Aware Adaptive Graph Convolutional Network for Age Estimation

This paper proposes a novel age estimation algorithm, the Temporally-Awa...

Bounded Residual Gradient Networks (BReG-Net) for Facial Affect Computing

Residual-based neural networks have shown remarkable results in various ...

A Multi-resolution Approach to Expression Recognition in the Wild

Facial expressions play a fundamental role in human communication. Indee...

The FaceChannelS: Strike of the Sequences for the AffWild 2 Challenge

Predicting affective information from human faces became a popular task ...

Code Repositories


Code for the paper 'Exploiting Emotional Dependencies with Graph Convolutional Networks for Facial Expression Recognition '

view repo