Learning Fair Classifiers in Online Stochastic Settings

08/19/2019
by   Yi Sun, et al.
0

In many real life situations, including job and loan applications, gatekeepers must make justified, real-time decisions about a person's fitness for a particular opportunity. People on both sides of such decisions have understandable concerns about their fairness, especially when they occur online or algorithmically. In this paper we consider the setting where we try to satisfy approximate fairness in an online decision making process where examples are sampled i.i.d from an underlying distribution. The fairness metric we consider is "equalized odds", which requires that approximately equalized false positive rates and false negative rates across groups. Our work follows from the classical learning from experts scheme and extends the multiplicative weights algorithm by maintaining an estimation for label distribution and keeping separate weights for label classes as well as groups. Our theoretical results show that approximate equalized odds can be achieved without sacrificing much regret from some distributions. We also demonstrate the algorithm on real data sets commonly used by the fairness community.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/28/2018

On preserving non-discrimination when combining expert advice

We study the interplay between sequential decision making and avoiding d...
research
02/06/2019

Equal Opportunity in Online Classification with Partial Feedback

We study an online classification problem with partial feedback in which...
research
06/19/2022

Fairness-aware Model-agnostic Positive and Unlabeled Learning

With the increasing application of machine learning in high-stake decisi...
research
11/05/2020

Convergent Algorithms for (Relaxed) Minimax Fairness

We consider a recently introduced framework in which fairness is measure...
research
09/18/2019

Advancing subgroup fairness via sleeping experts

We study methods for improving fairness to subgroups in settings with ov...
research
08/05/2020

Machine Learning Fairness in Justice Systems: Base Rates, False Positives, and False Negatives

Machine learning best practice statements have proliferated, but there i...
research
09/07/2019

Equalizing Recourse across Groups

The rise in machine learning-assisted decision-making has led to concern...

Please sign up or login with your details

Forgot password? Click here to reset