A survey of bias in Machine Learning through the prism of Statistical Parity for the Adult Data Set

03/31/2020
by   Philippe Besse, et al.
0

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of discrimination against specific groups of population or minorities? In this paper, we show the importance of understanding how a bias can be introduced into automatic decisions. We first present a mathematical framework for the fair learning problem, specifically in the binary classification setting. We then propose to quantify the presence of bias by using the standard Disparate Impact index on the real and well-known Adult income data set. Finally, we check the performance of different approaches aiming to reduce the bias in binary classification outcomes. Importantly, we show that some intuitive methods are ineffective. This sheds light on the fact trying to make fair machine learning models may be a particularly challenging task, in particular when the training observations contain a bias.

READ FULL TEXT

page 5

page 6

research
09/02/2019

Understanding Bias in Machine Learning

Bias is known to be an impediment to fair decisions in many domains such...
research
05/31/2023

Bias Mitigation Methods for Binary Classification Decision-Making Systems: Survey and Recommendations

Bias mitigation methods for binary classification decision-making system...
research
06/19/2019

Inherent Tradeoffs in Learning Fair Representation

With the prevalence of machine learning in high-stakes applications, esp...
research
10/26/2020

One-vs.-One Mitigation of Intersectional Bias: A General Method to Extend Fairness-Aware Binary Classification

With the widespread adoption of machine learning in the real world, the ...
research
05/31/2021

Model Mis-specification and Algorithmic Bias

Machine learning algorithms are increasingly used to inform critical dec...
research
11/19/2022

Quantifying Human Bias and Knowledge to guide ML models during Training

This paper discusses a crowdsourcing based method that we designed to qu...
research
04/12/2022

Detection and Mitigation of Algorithmic Bias via Predictive Rate Parity

Recently, numerous studies have demonstrated the presence of bias in mac...

Please sign up or login with your details

Forgot password? Click here to reset