Soliciting Stakeholders' Fairness Notions in Child Maltreatment Predictive Systems

02/01/2021
by   Hao Fei Cheng, et al.
0

Recent work in fair machine learning has proposed dozens of technical definitions of algorithmic fairness and methods for enforcing these definitions. However, we still lack an understanding of how to develop machine learning systems with fairness criteria that reflect relevant stakeholders' nuanced viewpoints in real-world contexts. To address this gap, we propose a framework for eliciting stakeholders' subjective fairness notions. Combining a user interface that allows stakeholders to examine the data and the algorithm's predictions with an interview protocol to probe stakeholders' thoughts while they are interacting with the interface, we can identify stakeholders' fairness beliefs and principles. We conduct a user study to evaluate our framework in the setting of a child maltreatment predictive system. Our evaluations show that the framework allows stakeholders to comprehensively convey their fairness viewpoints. We also discuss how our results can inform the design of predictive systems.

READ FULL TEXT

Authors

page 4

page 5

page 8

page 11

11/25/2018

50 Years of Test (Un)fairness: Lessons for Machine Learning

Quantitative definitions of what is unfair and what is fair have been in...
03/22/2019

The invisible power of fairness. How machine learning shapes democracy

Many machine learning systems make extensive use of large amounts of dat...
06/09/2021

Fair Disaster Containment via Graph-Cut Problems

Graph cut problems form a fundamental problem type in combinatorial opti...
03/10/2021

Fairness On The Ground: Applying Algorithmic Fairness Approaches to Production Systems

Many technical approaches have been proposed for ensuring that decisions...
02/21/2019

Capuchin: Causal Database Repair for Algorithmic Fairness

Fairness is increasingly recognized as a critical component of machine l...
05/14/2020

Statistical Equity: A Fairness Classification Objective

Machine learning systems have been shown to propagate the societal error...
06/20/2022

Algorithmic Fairness and Vertical Equity: Income Fairness with IRS Tax Audit Models

This study examines issues of algorithmic fairness in the context of sys...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.