Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition

03/15/2021
by   Nikhil Churamani, et al.
10

As Facial Expression Recognition (FER) systems become integrated into our daily lives, these systems need to prioritise making fair decisions instead of aiming at higher individual accuracy scores. Ranging from surveillance systems to diagnosing mental and emotional health conditions of individuals, these systems need to balance the accuracy vs fairness trade-off to make decisions that do not unjustly discriminate against specific under-represented demographic groups. Identifying bias as a critical problem in facial analysis systems, different methods have been proposed that aim to mitigate bias both at data and algorithmic levels. In this work, we propose the novel usage of Continual Learning (CL), in particular, using Domain-Incremental Learning (Domain-IL) settings, as a potent bias mitigation method to enhance the fairness of FER systems while guarding against biases arising from skewed data distributions. We compare different non-CL-based and CL-based methods for their classification accuracy and fairness scores on expression recognition and Action Unit (AU) detection tasks using two popular benchmarks, the RAF-DB and BP4D datasets, respectively. Our experimental results show that CL-based methods, on average, outperform other popular bias mitigation techniques on both accuracy and fairness metrics.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

03/15/2021

Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition

As affective robots become integral in human life, these agents must be ...
07/20/2020

Investigating Bias and Fairness in Facial Expression Recognition

Recognition of expressions of emotions and affect from facial images is ...
01/05/2022

The Effect of Model Compression on Fairness in Facial Expression Recognition

Deep neural networks have proved hugely successful, achieving human-like...
08/19/2021

Understanding and Mitigating Annotation Bias in Facial Expression Recognition

The performance of a computer vision model depends on the size and quali...
12/13/2021

Anatomizing Bias in Facial Analysis

Existing facial analysis systems have been shown to yield biased results...
02/10/2020

Post-Comparison Mitigation of Demographic Bias in Face Recognition Using Fair Score Normalization

Current face recognition systems achieved high progress on several bench...
07/05/2016

Aggressive actions and anger detection from multiple modalities using Kinect

Prison facilities, mental correctional institutions, sports bars and pla...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.