The Limits of Computation in Solving Equity Trade-Offs in Machine Learning and Justice System Risk Assessment

02/08/2021
by   Jesse Russell, et al.
0

This paper explores how different ideas of racial equity in machine learning, in justice settings in particular, can present trade-offs that are difficult to solve computationally. Machine learning is often used in justice settings to create risk assessments, which are used to determine interventions, resources, and punitive actions. Overall aspects and performance of these machine learning-based tools, such as distributions of scores, outcome rates by levels, and the frequency of false positives and true positives, can be problematic when examined by racial group. Models that produce different distributions of scores or produce a different relationship between level and outcome are problematic when those scores and levels are directly linked to the restriction of individual liberty and to the broader context of racial inequity. While computation can help highlight these aspects, data and computation are unlikely to solve them. This paper explores where values and mission might have to fill the spaces computation leaves.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/05/2020

Machine Learning Fairness in Justice Systems: Base Rates, False Positives, and False Negatives

Machine learning best practice statements have proliferated, but there i...
research
11/07/2017

Quality-Efficiency Trade-offs in Machine Learning for Text Processing

Data mining, machine learning, and natural language processing are power...
research
05/23/2020

Designing with Static Capabilities and Effects: Use, Mention, and Invariants

Capabilities (whether object or reference capabilities) are fundamentall...
research
10/26/2020

Enforcing Interpretability and its Statistical Impacts: Trade-offs between Accuracy and Interpretability

To date, there has been no formal study of the statistical cost of inter...
research
01/23/2023

Towards Modular Machine Learning Solution Development: Benefits and Trade-offs

Machine learning technologies have demonstrated immense capabilities in ...
research
10/08/2021

Stacking interventions for equitable outcomes

Predictive risk scores estimating probabilities for a binary outcome on ...
research
03/17/2023

Finding Competence Regions in Domain Generalization

We propose a "learning to reject" framework to address the problem of si...

Please sign up or login with your details

Forgot password? Click here to reset