The Hidden Inconsistencies Introduced by Predictive Algorithms in Judicial Decision Making

by   Travis Greene, et al.

Algorithms, from simple automation to machine learning, have been introduced into judicial contexts to ostensibly increase the consistency and efficiency of legal decision making. In this paper, we describe four types of inconsistencies introduced by risk prediction algorithms. These inconsistencies threaten to violate the principle of treating similar cases similarly and often arise from the need to operationalize legal concepts and human behavior into specific measures that enable the building and evaluation of predictive algorithms. These inconsistencies, however, are likely to be hidden from their end-users: judges, parole officers, lawyers, and other decision-makers. We describe the inconsistencies, their sources, and propose various possible indicators and solutions. We also consider the issue of inconsistencies due to the use of algorithms in light of current trends towards more autonomous algorithms and less human-understandable behavioral big data. We conclude by discussing judges and lawyers' duties of technological ("algorithmic") competence and call for greater alignment between the evaluation of predictive algorithms and corresponding judicial goals.



There are no comments yet.


page 1

page 2

page 3

page 4


Algorithmic risk assessments can alter human decision-making processes in high-stakes government contexts

Governments are increasingly turning to algorithmic risk assessments whe...

Legal perspective on possible fairness measures - A legal discussion using the example of hiring decisions (preprint)

With the increasing use of AI in algorithmic decision making (e.g. based...

When Does Uncertainty Matter?: Understanding the Impact of Predictive Uncertainty in ML Assisted Decision Making

As machine learning (ML) models are increasingly being employed to assis...

"Improving" prediction of human behavior using behavior modification

The fields of statistics and machine learning design algorithms, models,...

The Flaws of Policies Requiring Human Oversight of Government Algorithms

Policymakers around the world are increasingly considering how to preven...

Interpretable Low-Resource Legal Decision Making

Over the past several years, legal applications of deep learning have be...

Deconstructing the Dichotomous Relationship Between "IT analysts and End-users": A Case of Implementing Standard Indicators in Cameroon

Différance and supplément are post-structuralist concepts for analyzing ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.