Fair Attribute Classification through Latent Space De-biasing

12/02/2020
by   Vikram V. Ramaswamy, et al.
3

Fairness in visual recognition is becoming a prominent and critical topic of discussion as recognition systems are deployed at scale in the real world. Models trained from data in which target labels are correlated with protected attributes (e.g., gender, race) are known to learn and exploit those correlations. In this work, we introduce a method for training accurate target classifiers while mitigating biases that stem from these correlations. We use GANs to generate realistic-looking images, and perturb these images in the underlying latent space to generate training data that is balanced for each protected attribute. We augment the original dataset with this perturbed generated data, and empirically demonstrate that target classifiers trained on the augmented dataset exhibit a number of both quantitative and qualitative benefits. We conduct a thorough evaluation across multiple target labels and protected attributes in the CelebA dataset, and provide an in-depth analysis and comparison to existing literature in the space.

READ FULL TEXT

page 2

page 4

research
07/17/2021

Fair Balance: Mitigating Machine Learning Bias Against Multiple Protected Attributes With Data Balancing

This paper aims to improve machine learning fairness on multiple protect...
research
09/14/2022

CAT: Controllable Attribute Translation for Fair Facial Attribute Classification

As the social impact of visual recognition has been under scrutiny, seve...
research
04/13/2022

Mitigating Bias in Facial Analysis Systems by Incorporating Label Diversity

Facial analysis models are increasingly applied in real-world applicatio...
research
08/25/2023

Measuring Spurious Correlation in Classification: 'Clever Hans' in Translationese

Recent work has shown evidence of 'Clever Hans' behavior in high-perform...
research
04/29/2021

Discover the Unknown Biased Attribute of an Image Classifier

Recent works find that AI algorithms learn biases from data. Therefore, ...
research
07/19/2019

Fair quantile regression

Quantile regression is a tool for learning conditional distributions. In...
research
02/06/2023

Erasure of Unaligned Attributes from Neural Representations

We present the Assignment-Maximization Spectral Attribute removaL (AMSAL...

Please sign up or login with your details

Forgot password? Click here to reset