Machine learning for public policy: Do we need to sacrifice accuracy to make models fair?

by   Kit T Rodolfa, et al.

Growing applications of machine learning in policy settings have raised concern for fairness implications, especially for racial minorities, but little work has studied the practical trade-offs between fairness and accuracy in real-world settings. This empirical study fills this gap by investigating the accuracy cost of mitigating disparities across several policy settings, focusing on the common context of using machine learning to inform benefit allocation in resource-constrained programs across education, mental health, criminal justice, and housing safety. In each setting, explicitly focusing on achieving equity and using our proposed post-hoc disparity mitigation methods, fairness was substantially improved without sacrificing accuracy, challenging the commonly held assumption that reducing disparities either requires accepting an appreciable drop in accuracy or the development of novel, complex methods.


page 1

page 2

page 3

page 4


An Empirical Comparison of Bias Reduction Methods on Real-World Problems in High-Stakes Policy Settings

Applications of machine learning (ML) to high-stakes policy settings – s...

Fair AutoML

We present an end-to-end automated machine learning system to find machi...

Maintaining fairness across distribution shift: do we have viable solutions for real-world applications?

Fairness and robustness are often considered as orthogonal dimensions wh...

Consider the Alternatives: Navigating Fairness-Accuracy Tradeoffs via Disqualification

In many machine learning settings there is an inherent tension between f...

Investigating similarities and differences between South African and Sierra Leonean school outcomes using Machine Learning

Available or adequate information to inform decision making for resource...

A Distributed Fair Machine Learning Framework with Private Demographic Data Protection

Fair machine learning has become a significant research topic with broad...

An Empirical Study of Accuracy, Fairness, Explainability, Distributional Robustness, and Adversarial Robustness

To ensure trust in AI models, it is becoming increasingly apparent that ...