DeepAI
Log In Sign Up

Understanding and Mitigating Annotation Bias in Facial Expression Recognition

08/19/2021
by   Yunliang Chen, et al.
0

The performance of a computer vision model depends on the size and quality of its training data. Recent studies have unveiled previously-unknown composition biases in common image datasets which then lead to skewed model outputs, and have proposed methods to mitigate these biases. However, most existing works assume that human-generated annotations can be considered gold-standard and unbiased. In this paper, we reveal that this assumption can be problematic, and that special care should be taken to prevent models from learning such annotation biases. We focus on facial expression recognition and compare the label biases between lab-controlled and in-the-wild datasets. We demonstrate that many expression datasets contain significant annotation biases between genders, especially when it comes to the happy and angry expressions, and that traditional methods cannot fully mitigate such biases in trained models. To remove expression annotation bias, we propose an AU-Calibrated Facial Expression Recognition (AUC-FER) framework that utilizes facial action units (AUs) and incorporates the triplet loss into the objective function. Experimental results suggest that the proposed method is more effective in removing expression annotation bias than existing techniques.

READ FULL TEXT
04/13/2022

Mitigating Bias in Facial Analysis Systems by Incorporating Label Diversity

Facial analysis models are increasingly applied in real-world applicatio...
09/30/2022

Rethinking the Learning Paradigm for Facial Expression Recognition

Due to the subjective crowdsourcing annotations and the inherent inter-c...
12/29/2020

AU-Expression Knowledge Constrained Representation Learning for Facial Expression Recognition

Recognizing human emotion/expressions automatically is quite an expected...
10/17/2014

Learning visual biases from human imagination

Although the human visual system can recognize many concepts under chall...
03/15/2021

Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition

As Facial Expression Recognition (FER) systems become integrated into ou...