Deep Multi-task Learning for Facial Expression Recognition and Synthesis Based on Selective Feature Sharing

07/09/2020
by   Rui Zhao, et al.
0

Multi-task learning is an effective learning strategy for deep-learning-based facial expression recognition tasks. However, most existing methods take into limited consideration the feature selection, when transferring information between different tasks, which may lead to task interference when training the multi-task networks. To address this problem, we propose a novel selective feature-sharing method, and establish a multi-task network for facial expression recognition and facial expression synthesis. The proposed method can effectively transfer beneficial features between different tasks, while filtering out useless and harmful information. Moreover, we employ the facial expression synthesis task to enlarge and balance the training dataset to further enhance the generalization ability of the proposed method. Experimental results show that the proposed method achieves state-of-the-art performance on those commonly used facial expression recognition benchmarks, which makes it a potential solution to real-world facial expression recognition problems.

READ FULL TEXT

page 3

page 6

research
11/08/2019

Dynamic Multi-Task Learning for Face Recognition with Facial Expression

Benefiting from the joint learning of the multiple tasks in the deep mul...
research
08/06/2020

Noisy Student Training using Body Language Dataset Improves Facial Expression Recognition

Facial expression recognition from videos in the wild is a challenging t...
research
11/17/2020

Towards All-around Knowledge Transferring: Learning From Task-irrelevant Labels

Deep neural models have hitherto achieved significant performances on nu...
research
01/25/2018

Using Deep Autoencoders for Facial Expression Recognition

Feature descriptors involved in image processing are generally manually ...
research
05/14/2021

Meta Auxiliary Learning for Facial Action Unit Detection

Despite the success of deep neural networks on facial action unit (AU) d...
research
04/27/2020

Semantic Neighborhood-Aware Deep Facial Expression Recognition

Different from many other attributes, facial expression can change in a ...
research
03/24/2022

Privileged Attribution Constrained Deep Networks for Facial Expression Recognition

Facial Expression Recognition (FER) is crucial in many research domains ...

Please sign up or login with your details

Forgot password? Click here to reset