Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robust

11/06/2022
by   Haotian Chen, et al.
0

Legal judgment Prediction (LJP), aiming to predict a judgment based on fact descriptions, serves as legal assistance to mitigate the great work burden of limited legal practitioners. Most existing methods apply various large-scale pre-trained language models (PLMs) finetuned in LJP tasks to obtain consistent improvements. However, we discover the fact that the state-of-the-art (SOTA) model makes judgment predictions according to wrong (or non-casual) information, which not only weakens the model's generalization capability but also results in severe social problems like discrimination. Here, we analyze the causal mechanism misleading the LJP model to learn the spurious correlations, and then propose a framework to guide the model to learn the underlying causality knowledge in the legal texts. Specifically, we first perform open information extraction (OIE) to refine the text having a high proportion of causal information, according to which we generate a new set of data. Then, we design a model learning the weights of the refined data and the raw data for LJP model training. The extensive experimental results show that our model is more generalizable and robust than the baselines and achieves a new SOTA performance on two commonly used legal-specific datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2020

Knowledge-aware Method for Confusing Charge Prediction

Automatic charge prediction task aims to determine the final charges bas...
research
05/11/2023

THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrieval

Legal case retrieval techniques play an essential role in modern intelli...
research
07/04/2018

CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction

In this paper, we introduce the Chinese AI and Law challenge dataset (CA...
research
04/19/2021

Everything Has a Cause: Leveraging Causal Inference in Legal Text Analysis

Causal inference is the process of capturing cause-effect relationship a...
research
06/20/2023

FAIR: A Causal Framework for Accurately Inferring Judgments Reversals

Artificial intelligence researchers have made significant advances in le...
research
10/31/2022

Do Charge Prediction Models Learn Legal Theory?

The charge prediction task aims to predict the charge for a case given i...
research
05/10/2019

Legal Judgment Prediction via Multi-Perspective Bi-Feedback Network

The Legal Judgment Prediction (LJP) is to determine judgment results bas...

Please sign up or login with your details

Forgot password? Click here to reset