A Resolution in Algorithmic Fairness: Calibrated Scores for Fair Classifications

02/18/2020
by   Claire Lazar, et al.
0

Calibration and equal error rates are fundamental conditions for algorithmic fairness that have been shown to conflict with each other, suggesting that they cannot be satisfied simultaneously. This paper shows that the two are in fact compatible and presents a method for reconciling them. In particular, we derive necessary and sufficient conditions for the existence of calibrated scores that yield classifications achieving equal error rates. We then present an algorithm that searches for the most informative score subject to both calibration and minimal error rate disparity. Applied empirically to credit lending, our algorithm provides a solution that is more fair and profitable than a common alternative that omits sensitive features.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/06/2017

On Fairness and Calibration

The machine learning community has become increasingly concerned with th...
research
05/17/2023

Properties of the ENCE and other MAD-based calibration metrics

The Expected Normalized Calibration Error (ENCE) is a popular calibratio...
research
07/06/2022

Towards Substantive Conceptions of Algorithmic Fairness: Normative Guidance from Equal Opportunity Doctrines

In this work we use Equal Oppportunity (EO) doctrines from political phi...
research
09/30/2022

Variable-Based Calibration for Machine Learning Classifiers

The deployment of machine learning classifiers in high-stakes domains re...
research
04/01/2021

Out of a hundred trials, how many errors does your speaker verifier make?

Out of a hundred trials, how many errors does your speaker verifier make...
research
01/08/2021

QAOA-based Fair Sampling on NISQ Devices

We study the status of fair sampling on Noisy Intermediate Scale Quantum...
research
05/25/2023

Monitoring Algorithmic Fairness

Machine-learned systems are in widespread use for making decisions about...

Please sign up or login with your details

Forgot password? Click here to reset