Fairness Metrics: A Comparative Analysis

01/22/2020
by   Pratyush Garg, et al.
0

Algorithmic fairness is receiving significant attention in the academic and broader literature due to the increasing use of predictive algorithms, including those based on artificial intelligence. One benefit of this trend is that algorithm designers and users have a growing set of fairness measures to choose from. However, this choice comes with the challenge of identifying how the different fairness measures relate to one another, as well as the extent to which they are compatible or mutually exclusive. We describe some of the most widely used fairness metrics using a common mathematical framework and present new results on the relationships among them. The results presented herein can help place both specialists and non-specialists in a better position to identify the metric best suited for their application and goals.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/29/2022

Properties of Group Fairness Metrics for Rankings

In recent years, several metrics have been developed for evaluating grou...
research
02/16/2021

Towards the Right Kind of Fairness in AI

Fairness is a concept of justice. Various definitions exist, some of the...
research
08/22/2022

Evaluation of group fairness measures in student performance prediction problems

Predicting students' academic performance is one of the key tasks of edu...
research
06/02/2022

Algorithmic Fairness and Structural Injustice: Insights from Feminist Political Philosophy

Data-driven predictive algorithms are widely used to automate and guide ...
research
07/02/2023

Equal Confusion Fairness: Measuring Group-Based Disparities in Automated Decision Systems

As artificial intelligence plays an increasingly substantial role in dec...
research
07/12/2021

Mathematical Analysis of Redistricting in Utah

We investigate the claim that the Utah congressional districts enacted i...
research
10/22/2020

The Pursuit of Algorithmic Fairness: On "Correcting" Algorithmic Unfairness in a Child Welfare Reunification Success Classifier

The algorithmic fairness of predictive analytic tools in the public sect...

Please sign up or login with your details

Forgot password? Click here to reset