Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition

03/15/2021
by   Ozgur Kara, et al.
28

As affective robots become integral in human life, these agents must be able to fairly evaluate human affective expressions without discriminating against specific demographic groups. Identifying bias in Machine Learning (ML) systems as a critical problem, different approaches have been proposed to mitigate such biases in the models both at data and algorithmic levels. In this work, we propose Continual Learning (CL) as an effective strategy to enhance fairness in Facial Expression Recognition (FER) systems, guarding against biases arising from imbalances in data distributions. We compare different state-of-the-art bias mitigation approaches with CL-based strategies for fairness on expression recognition and Action Unit (AU) detection tasks using popular benchmarks for each; RAF-DB and BP4D. Our experiments show that CL-based methods, on average, outperform popular bias mitigation techniques, strengthening the need for further investigation into CL for the development of fairer FER algorithms.

READ FULL TEXT
research
03/15/2021

Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition

As Facial Expression Recognition (FER) systems become integrated into ou...
research
05/10/2023

Continual Facial Expression Recognition: A Benchmark

Understanding human affective behaviour, especially in the dynamics of r...
research
07/20/2020

Investigating Bias and Fairness in Facial Expression Recognition

Recognition of expressions of emotions and affect from facial images is ...
research
03/08/2023

Using Positive Matching Contrastive Loss with Facial Action Units to mitigate bias in Facial Expression Recognition

Machine learning models automatically learn discriminative features from...
research
08/19/2021

Understanding and Mitigating Annotation Bias in Facial Expression Recognition

The performance of a computer vision model depends on the size and quali...
research
08/11/2023

Complex Facial Expression Recognition Using Deep Knowledge Distillation of Basic Features

Complex emotion recognition is a cognitive task that has so far eluded t...
research
01/05/2022

The Effect of Model Compression on Fairness in Facial Expression Recognition

Deep neural networks have proved hugely successful, achieving human-like...

Please sign up or login with your details

Forgot password? Click here to reset