Prediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions

11/19/2018
by   Shira Mitchell, et al.
0

A recent flurry of research activity has attempted to quantitatively define "fairness" for decisions based on statistical and machine learning (ML) predictions. The rapid growth of this new field has led to wildly inconsistent terminology and notation, presenting a serious challenge for cataloguing and comparing definitions. This paper attempts to bring much-needed order. First, we explicate the various choices and assumptions made---often implicitly---to justify the use of prediction-based decisions. Next, we show how such choices and assumptions can raise concerns about fairness and we present a notationally consistent catalogue of fairness definitions from the ML literature. In doing so, we offer a concise reference for thinking through the choices, assumptions, and fairness considerations of prediction-based decision systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2021

The zoo of Fairness metrics in Machine Learning

In recent years, the problem of addressing fairness in Machine Learning ...
research
11/25/2019

On the Legal Compatibility of Fairness Definitions

Past literature has been effective in demonstrating ideological gaps in ...
research
02/01/2021

Emergent Unfairness: Normative Assumptions and Contradictions in Algorithmic Fairness-Accuracy Trade-Off Research

Across machine learning (ML) sub-disciplines, researchers make explicit ...
research
10/20/2020

Where Is the Normative Proof? Assumptions and Contradictions in ML Fairness Research

Across machine learning (ML) sub-disciplines researchers make mathematic...
research
05/19/2022

What Is Fairness? Implications For FairML

A growing body of literature in fairness-aware ML (fairML) aspires to mi...
research
12/17/2019

Human Comprehension of Fairness in Machine Learning

Bias in machine learning has manifested injustice in several areas, such...
research
04/10/2023

FairPilot: An Explorative System for Hyperparameter Tuning through the Lens of Fairness

Despite the potential benefits of machine learning (ML) in high-risk dec...

Please sign up or login with your details

Forgot password? Click here to reset