Are Models Trained on Indian Legal Data Fair?

03/13/2023
by   Sahil Girhepuje, et al.
19

Recent advances and applications of language technology and artificial intelligence have enabled much success across multiple domains like law, medical and mental health. AI-based Language Models, like Judgement Prediction, have recently been proposed for the legal sector. However, these models are strife with encoded social biases picked up from the training data. While bias and fairness have been studied across NLP, most studies primarily locate themselves within a Western context. In this work, we present an initial investigation of fairness from the Indian perspective in the legal domain. We highlight the propagation of learnt algorithmic biases in the bail prediction task for models trained on Hindi legal documents. We evaluate the fairness gap using demographic parity and show that a decision tree model trained for the bail prediction task has an overall fairness disparity of 0.237 between input features associated with Hindus and Muslims. Additionally, we highlight the need for further research and studies in the avenues of fairness/bias in applying AI in the legal sector with a specific focus on the Indian context.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2021

Identifying biases in legal data: An algorithmic fairness perspective

The need to address representation biases and sentencing disparities in ...
research
09/12/2018

Extracting Fairness Policies from Legal Documents

Machine Learning community is recently exploring the implications of bia...
research
06/14/2023

Compatibility of Fairness Metrics with EU Non-Discrimination Laws: Demographic Parity Conditional Demographic Disparity

Empirical evidence suggests that algorithmic decisions driven by Machine...
research
09/10/2020

On the Fairness of 'Fake' Data in Legal AI

The economics of smaller budgets and larger case numbers necessitates th...
research
03/25/2021

Equality before the Law: Legal Judgment Consistency Analysis for Fairness

In a legal system, judgment consistency is regarded as one of the most i...
research
08/29/2022

Bias Impact Analysis of AI in Consumer Mobile Health Technologies: Legal, Technical, and Policy

Today's large-scale algorithmic and automated deployment of decision-mak...
research
09/25/2022

Re-contextualizing Fairness in NLP: The Case of India

Recent research has revealed undesirable biases in NLP data and models. ...

Please sign up or login with your details

Forgot password? Click here to reset