Machine learning for public policy: Do we need to sacrifice accuracy to make models fair?

12/05/2020
by   Kit T Rodolfa, et al.
29

Growing applications of machine learning in policy settings have raised concern for fairness implications, especially for racial minorities, but little work has studied the practical trade-offs between fairness and accuracy in real-world settings. This empirical study fills this gap by investigating the accuracy cost of mitigating disparities across several policy settings, focusing on the common context of using machine learning to inform benefit allocation in resource-constrained programs across education, mental health, criminal justice, and housing safety. In each setting, explicitly focusing on achieving equity and using our proposed post-hoc disparity mitigation methods, fairness was substantially improved without sacrificing accuracy, challenging the commonly held assumption that reducing disparities either requires accepting an appreciable drop in accuracy or the development of novel, complex methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/13/2021

An Empirical Comparison of Bias Reduction Methods on Real-World Problems in High-Stakes Policy Settings

Applications of machine learning (ML) to high-stakes policy settings – s...
research
11/11/2021

Fair AutoML

We present an end-to-end automated machine learning system to find machi...
research
05/22/2023

Causality-Aided Trade-off Analysis for Machine Learning Fairness

There has been an increasing interest in enhancing the fairness of machi...
research
02/02/2022

Maintaining fairness across distribution shift: do we have viable solutions for real-world applications?

Fairness and robustness are often considered as orthogonal dimensions wh...
research
10/02/2021

Consider the Alternatives: Navigating Fairness-Accuracy Tradeoffs via Disqualification

In many machine learning settings there is an inherent tension between f...
research
04/22/2020

Investigating similarities and differences between South African and Sierra Leonean school outcomes using Machine Learning

Available or adequate information to inform decision making for resource...
research
12/22/2022

Designing Equitable Transit Networks

Public transit is an essential infrastructure enabling access to employm...

Please sign up or login with your details

Forgot password? Click here to reset