Fairness Evaluation in Presence of Biased Noisy Labels

03/30/2020
by   Riccardo Fogliato, et al.
0

Risk assessment tools are widely used around the country to inform decision making within the criminal justice system. Recently, considerable attention has been devoted to the question of whether such tools may suffer from racial bias. In this type of assessment, a fundamental issue is that the training and evaluation of the model is based on a variable (arrest) that may represent a noisy version of an unobserved outcome of more central interest (offense). We propose a sensitivity analysis framework for assessing how assumptions on the noise across groups affect the predictive bias properties of the risk assessment model as a predictor of reoffense. Our experimental results on two real world criminal justice data sets demonstrate how even small biases in the observed labels may call into question the conclusions of an analysis based on the noisy outcome.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2023

An assessment of racial disparities in pretrial decision-making using misclassification models

Pretrial risk assessment tools are used in jurisdictions across the coun...
research
10/08/2020

Assessing the Fairness of Classifiers with Collider Bias

The increasing maturity of machine learning technologies and their appli...
research
04/04/2018

Qualitätsmaße binärer Klassifikationen im Bereich kriminalprognostischer Instrumente der vierten Generation

This master's thesis discusses an important issue regarding how algorith...
research
05/12/2023

The Progression of Disparities within the Criminal Justice System: Differential Enforcement and Risk Assessment Instruments

Algorithmic risk assessment instruments (RAIs) increasingly inform decis...
research
11/28/2020

Feedback Effects in Repeat-Use Criminal Risk Assessments

In the criminal legal context, risk assessment algorithms are touted as ...
research
03/01/2022

Judging the algorithm: A case study on the risk assessment tool for gender-based violence implemented in the Basque country

Since 2010, the output of a risk assessment tool that predicts how likel...

Please sign up or login with your details

Forgot password? Click here to reset