Judging the algorithm: A case study on the risk assessment tool for gender-based violence implemented in the Basque country

03/01/2022
by   Ana Valdivia, et al.
0

Since 2010, the output of a risk assessment tool that predicts how likely an individual is to commit severe violence against their partner has been integrated within the Basque country courtrooms. The EPV-R, the tool developed to assist police officers during the assessment of gender-based violence cases, was also incorporated to assist the decision-making of judges. With insufficient training, judges are exposed to an algorithmic output that influences the human decision of adopting measures in cases of gender-based violence. In this paper, we examine the risks, harms and limits of algorithmic governance within the context of gender-based violence. Through the lens of an Spanish judge exposed to this tool, we analyse how the EPV-R is impacting on the justice system. Moving beyond the risks of unfair and biased algorithmic outputs, we examine legal, social and technical pitfalls such as opaque implementation, efficiency's paradox and feedback loop, that could led to unintended consequences on women who suffer gender-based violence. Our interdisciplinary framework highlights the importance of understanding the impact and influence of risk assessment tools within judicial decision-making and increase awareness about its implementation in this context.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2020

A Risk Assessment of a Pretrial Risk Assessment Tool: Tussles, Mitigation Strategies, and Inherent Limits

We perform a risk assessment of the Public Safety Assessment (PSA), a so...
research
03/11/2022

How to Train a (Bad) Algorithmic Caseworker: A Quantitative Deconstruction of Risk Assessments in Child-Welfare

Child welfare (CW) agencies use risk assessment tools as a means to achi...
research
02/19/2020

A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores

The increased use of algorithmic predictions in sensitive domains has be...
research
06/22/2021

Machine learning for risk assessment in gender-based crime

Gender-based crime is one of the most concerning scourges of contemporar...
research
01/26/2021

Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems

This paper introduces reviewability as a framework for improving the acc...
research
03/30/2020

Fairness Evaluation in Presence of Biased Noisy Labels

Risk assessment tools are widely used around the country to inform decis...
research
09/02/2019

Defining and Adopting an End User Computing Policy: A Case Study

End User Computing carries significant risks if not well controlled. Thi...

Please sign up or login with your details

Forgot password? Click here to reset