Prior Information based Decomposition and Reconstruction Learning for Micro-Expression Recognition

03/03/2023
by   Jinsheng Wei, et al.
0

Micro-expression recognition (MER) draws intensive research interest as micro-expressions (MEs) can infer genuine emotions. Prior information can guide the model to learn discriminative ME features effectively. However, most works focus on researching the general models with a stronger representation ability to adaptively aggregate ME movement information in a holistic way, which may ignore the prior information and properties of MEs. To solve this issue, driven by the prior information that the category of ME can be inferred by the relationship between the actions of facial different components, this work designs a novel model that can conform to this prior information and learn ME movement features in an interpretable way. Specifically, this paper proposes a Decomposition and Reconstruction-based Graph Representation Learning (DeRe-GRL) model to effectively learn high-level ME features. DeRe-GRL includes two modules: Action Decomposition Module (ADM) and Relation Reconstruction Module (RRM), where ADM learns action features of facial key components and RRM explores the relationship between these action features. Based on facial key components, ADM divides the geometric movement features extracted by the graph model-based backbone into several sub-features, and learns the map matrix to map these sub-features into multiple action features; then, RRM learns weights to weight all action features to build the relationship between action features. The experimental results demonstrate the effectiveness of the proposed modules, and the proposed method achieves competitive performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/01/2022

Geometric Graph Representation with Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition

Micro-expression recognition (MER) is valuable because the involuntary n...
research
04/12/2021

Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition

In this paper, we propose a novel Feature Decomposition and Reconstructi...
research
03/21/2023

Self-Paced Neutral Expression-Disentangled Learning for Facial Expression Recognition

The accuracy of facial expression recognition is typically affected by t...
research
12/24/2020

Objective Class-based Micro-Expression Recognition through Simultaneous Action Unit Detection and Feature Aggregation

Micro-expression recognition (MER) has attracted lots of researchers' at...
research
08/08/2023

Facial Prior Based First Order Motion Model for Micro-expression Generation

Spotting facial micro-expression from videos finds various potential app...
research
05/02/2022

Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition

The activations of Facial Action Units (AUs) mutually influence one anot...

Please sign up or login with your details

Forgot password? Click here to reset