Feature Pyramid Network for Multi-task Affective Analysis

07/08/2021
by   Ruian He, et al.
0

Affective Analysis is not a single task, and the valence-arousal value, expression class and action unit can be predicted at the same time. Previous researches failed to take them as a whole task or ignore the entanglement and hierarchical relation of this three facial attributes. We propose a novel model named feature pyramid networks for multi-task affect analysis. The hierarchical features are extracted to predict three labels and we apply teacher-student training strategy to learn from pretrained single-task models. Extensive experiment results demonstrate the proposed model outperform other models.This is a submission to The 2nd Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW). The code and model are available for research purposes at https://github.com/ryanhe312/ABAW2-FPNMAA.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/20/2022

Facial Affect Analysis: Learning from Synthetic Data Multi-Task Learning Challenges

Facial affect analysis remains a challenging task with its setting trans...
research
07/08/2021

Multitask Multi-database Emotion Recognition

In this work, we introduce our submission to the 2nd Affective Behavior ...
research
07/19/2022

SS-MFAR : Semi-supervised Multi-task Facial Affect Recognition

Automatic affect recognition has applications in many areas such as educ...
research
07/09/2021

A Multi-task Mean Teacher for Semi-supervised Facial Affective Behavior Analysis

Affective Behavior Analysis is an important part in human-computer inter...
research
09/11/2020

UPB at SemEval-2020 Task 6: Pretrained Language Models for Definition Extraction

This work presents our contribution in the context of the 6th task of Se...
research
07/09/2021

A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognition

Analyzing human affect is vital for human-computer interaction systems. ...
research
02/17/2019

Online PCB Defect Detector On A New PCB Defect Dataset

Previous works for PCB defect detection based on image difference and im...

Please sign up or login with your details

Forgot password? Click here to reset