Attentive Deep Neural Networks for Legal Document Retrieval

12/13/2022
by   Ha-Thanh Nguyen, et al.
0

Legal text retrieval serves as a key component in a wide range of legal text processing tasks such as legal question answering, legal case entailment, and statute law retrieval. The performance of legal text retrieval depends, to a large extent, on the representation of text, both query and legal documents. Based on good representations, a legal text retrieval model can effectively match the query to its relevant documents. Because legal documents often contain long articles and only some parts are relevant to queries, it is quite a challenge for existing models to represent such documents. In this paper, we study the use of attentive neural network-based text representation for statute law document retrieval. We propose a general approach using deep neural networks with attention mechanisms. Based on it, we develop two hierarchical architectures with sparse attention to represent long sentences and articles, and we name them Attentive CNN and Paraformer. The methods are evaluated on datasets of different sizes and characteristics in English, Japanese, and Vietnamese. Experimental results show that: i) Attentive neural methods substantially outperform non-neural methods in terms of retrieval performance across datasets and languages; ii) Pretrained transformer-based models achieve better accuracy on small datasets at the cost of high computational complexity while lighter weight Attentive CNN achieves better accuracy on large datasets; and iii) Our proposed Paraformer outperforms state-of-the-art methods on COLIEE dataset, achieving the highest recall and F2 scores in the top-N retrieval task.

READ FULL TEXT
research
03/15/2022

Toward Improving Attentive Neural Networks in Legal Text Processing

In recent years, thanks to breakthroughs in neural network techniques es...
research
08/09/2021

DoSSIER@COLIEE 2021: Leveraging dense retrieval and summarization-based re-ranking for case law retrieval

In this paper, we present our approaches for the case law retrieval and ...
research
07/29/2023

Analysing the Resourcefulness of the Paragraph for Precedence Retrieval

Developing methods for extracting relevant legal information to aid lega...
research
03/08/2023

Automatic Detection of Industry Sectors in Legal Articles Using Machine Learning Approaches

The ability to automatically identify industry sector coverage in articl...
research
01/30/2023

Finding the Law: Enhancing Statutory Article Retrieval via Graph Neural Networks

Statutory article retrieval (SAR), the task of retrieving statute law ar...
research
05/30/2019

Threshold-Based Retrieval and Textual Entailment Detection on Legal Bar Exam Questions

Getting an overview over the legal domain has become challenging, especi...
research
08/20/2021

Supervised Contrastive Learning for Interpretable Long Document Comparison

Recent advancements in deep learning techniques have transformed the are...

Please sign up or login with your details

Forgot password? Click here to reset