DeepAI AI Chat
Log In Sign Up

On the relation between accuracy and fairness in binary classification

by   Indre Zliobaite, et al.

Our study revisits the problem of accuracy-fairness tradeoff in binary classification. We argue that comparison of non-discriminatory classifiers needs to account for different rates of positive predictions, otherwise conclusions about performance may be misleading, because accuracy and discrimination of naive baselines on the same dataset vary with different rates of positive predictions. We provide methodological recommendations for sound comparison of non-discriminatory classifiers, and present a brief theoretical and empirical analysis of tradeoffs between accuracy and non-discrimination.


page 1

page 2

page 3

page 4


How to Control the Error Rates of Binary Classifiers

The traditional binary classification framework constructs classifiers w...

Learning Fair Classifiers: A Regularization-Inspired Approach

We present a regularization-inspired approach for reducing bias in learn...

Phoneme discrimination using KS-algebra II

KS-algebra consists of expressions constructed with four kinds operation...

A critical assessment of conformal prediction methods applied in binary classification settings

In recent years there has been an increase in the number of scientific p...

Statistical Guarantees for Fairness Aware Plug-In Algorithms

A plug-in algorithm to estimate Bayes Optimal Classifiers for fairness-a...

The Fairness of Risk Scores Beyond Classification: Bipartite Ranking and the xAUC Metric

Where machine-learned predictive risk scores inform high-stakes decision...