DeepAI AI Chat
Log In Sign Up

AU-Guided Unsupervised Domain Adaptive Facial Expression Recognition

by   Kai Wang, et al.

The domain diversities including inconsistent annotation and varied image collection conditions inevitably exist among different facial expression recognition (FER) datasets, which pose an evident challenge for adapting the FER model trained on one dataset to another one. Recent works mainly focus on domain-invariant deep feature learning with adversarial learning mechanism, ignoring the sibling facial action unit (AU) detection task which has obtained great progress. Considering AUs objectively determine facial expressions, this paper proposes an AU-guided unsupervised Domain Adaptive FER (AdaFER) framework. In AdaFER, we first leverage an advanced model for AU detection on both source and target domain. Then, we compare the AU results to perform AU-guided annotating, i.e., target faces that own the same AUs with source faces would inherit the labels from source domain. Meanwhile, to achieve domain-invariant compact features, we utilize an AU-guided triplet training which randomly collects anchor-positive-negative triplets on both domains with AUs. We conduct extensive experiments on several popular benchmarks and show that AdaFER achieves state-of-the-art results on all the benchmarks.


page 3

page 4

page 6


Pose-aware Adversarial Domain Adaptation for Personalized Facial Expression Recognition

Current facial expression recognition methods fail to simultaneously cop...

Adversarial Graph Representation Adaptation for Cross-Domain Facial Expression Recognition

Data inconsistency and bias are inevitable among different facial expres...

Improve Unsupervised Domain Adaptation with Mixup Training

Unsupervised domain adaptation studies the problem of utilizing a releva...

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption

Unsupervised domain adaption aims to learn a powerful classifier for the...

Agnostic Domain Generalization

The ability to generalize across visual domains is crucial for the robus...

Multi-Domain Norm-referenced Encoding Enables Data Efficient Transfer Learning of Facial Expression Recognition

People can innately recognize human facial expressions in unnatural form...

Weakly-Supervised Unconstrained Action Unit Detection via Feature Disentanglement

Facial action unit (AU) detection in the wild is a challenging problem, ...