DeepAI AI Chat
Log In Sign Up

Counterfactual Fairness Is Basically Demographic Parity

08/07/2022
by   Lucas Rosenblatt, et al.
0

Making fair decisions is crucial to ethically implementing machine learning algorithms in social settings. In this work, we consider the celebrated definition of counterfactual fairness [Kusner et al., NeurIPS, 2017]. We begin by showing that an algorithm which satisfies counterfactual fairness also satisfies demographic parity, a far simpler fairness constraint. Similarly, we show that all algorithms satisfying demographic parity can be trivially modified to satisfy counterfactual fairness. Together, our results indicate that counterfactual fairness is basically equivalent to demographic parity, which has important implications for the growing body of work on counterfactual fairness. We then validate our theoretical findings empirically, analyzing three existing algorithms for counterfactual fairness against three simple benchmarks. We find that two simple benchmark algorithms outperform all three existing algorithms – in terms of fairness, accuracy, and efficiency – on several data sets. Our analysis leads us to formalize a concrete fairness goal: to preserve the order of individuals within protected groups. We believe transparency around the ordering of individuals within protected groups makes fair algorithms more trustworthy. By design, the two simple benchmark algorithms satisfy this goal while the existing algorithms for counterfactual fairness do not.

READ FULL TEXT

page 1

page 2

page 3

page 4

08/11/2021

Fairness Through Counterfactual Utilities

Group fairness definitions such as Demographic Parity and Equal Opportun...
05/30/2022

Metrizing Fairness

We study supervised learning problems for predicting properties of indiv...
10/16/2019

Conditional Learning of Fair Representations

We propose a novel algorithm for learning fair representations that can ...
11/21/2022

Bursting the Burden Bubble? An Assessment of Sharma et al.'s Counterfactual-based Fairness Metric

Machine learning has seen an increase in negative publicity in recent ye...
04/09/2022

Are Two Heads the Same as One? Identifying Disparate Treatment in Fair Neural Networks

We show that deep neural networks that satisfy demographic parity do so ...
02/09/2022

Prediction Sensitivity: Continual Audit of Counterfactual Fairness in Deployed Classifiers

As AI-based systems increasingly impact many areas of our lives, auditin...
03/14/2023

Demographic Parity Inspector: Fairness Audits via the Explanation Space

Even if deployed with the best intentions, machine learning methods can ...