DeepAI AI Chat
Log In Sign Up

Fairness Evaluation in Presence of Biased Noisy Labels

by   Riccardo Fogliato, et al.

Risk assessment tools are widely used around the country to inform decision making within the criminal justice system. Recently, considerable attention has been devoted to the question of whether such tools may suffer from racial bias. In this type of assessment, a fundamental issue is that the training and evaluation of the model is based on a variable (arrest) that may represent a noisy version of an unobserved outcome of more central interest (offense). We propose a sensitivity analysis framework for assessing how assumptions on the noise across groups affect the predictive bias properties of the risk assessment model as a predictor of reoffense. Our experimental results on two real world criminal justice data sets demonstrate how even small biases in the observed labels may call into question the conclusions of an analysis based on the noisy outcome.


page 1

page 2

page 3

page 4


Assessing the Fairness of Classifiers with Collider Bias

The increasing maturity of machine learning technologies and their appli...

Counterfactual Risk Assessments, Evaluation, and Fairness

Algorithmic risk assessments are increasingly used to help humans make d...

Qualitätsmaße binärer Klassifikationen im Bereich kriminalprognostischer Instrumente der vierten Generation

This master's thesis discusses an important issue regarding how algorith...

Feedback Effects in Repeat-Use Criminal Risk Assessments

In the criminal legal context, risk assessment algorithms are touted as ...

Assessing Risks of Biases in Cognitive Decision Support Systems

Recognizing, assessing, countering, and mitigating the biases of differe...

Counterfactual Risk Assessments under Unmeasured Confounding

Statistical risk assessments inform consequential decisions, such as pre...