MER-GCN: Micro Expression Recognition Based on Relation Modeling with Graph Convolutional Network

04/19/2020
by   Ling Lo, et al.
0

Micro-Expression (ME) is the spontaneous, involuntary movement of a face that can reveal the true feeling. Recently, increasing researches have paid attention to this field combing deep learning techniques. Action units (AUs) are the fundamental actions reflecting the facial muscle movements and AU detection has been adopted by many researches to classify facial expressions. However, the time-consuming annotation process makes it difficult to correlate the combinations of AUs to specific emotion classes. Inspired by the nodes relationship building Graph Convolutional Networks (GCN), we propose an end-to-end AU-oriented graph classification network, namely MER-GCN, which uses 3D ConvNets to extract AU features and applies GCN layers to discover the dependency laying between AU nodes for ME categorization. To our best knowledge, this work is the first end-to-end architecture for Micro-Expression Recognition (MER) using AUs based GCN. The experimental results show that our approach outperforms CNN-based MER networks.

READ FULL TEXT
research
10/26/2020

Video-based Facial Expression Recognition using Graph Convolutional Networks

Facial expression recognition (FER), aiming to classify the expression p...
research
10/23/2019

Relation Modeling with Graph Convolutional Networks for Facial Action Unit Detection

Most existing AU detection works considering AU relationships are relyin...
research
03/16/2023

AU-aware graph convolutional network for Macro- and Micro-expression spotting

Automatic Micro-Expression (ME) spotting in long videos is a crucial ste...
research
12/24/2020

Objective Class-based Micro-Expression Recognition through Simultaneous Action Unit Detection and Feature Aggregation

Micro-expression recognition (MER) has attracted lots of researchers' at...
research
03/10/2022

Transferring Dual Stochastic Graph Convolutional Network for Facial Micro-expression Recognition

Micro-expression recognition has drawn increasing attention due to its w...
research
08/05/2021

Enterprise Analytics using Graph Database and Graph-based Deep Learning

In a business-to-business (B2B) customer relationship management (CRM) u...
research
03/16/2019

Fast Interactive Object Annotation with Curve-GCN

Manually labeling objects by tracing their boundaries is a laborious pro...

Please sign up or login with your details

Forgot password? Click here to reset