DeepAI
Log In Sign Up

Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

05/09/2021
by   Chaojun Xiao, et al.
3

Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of artificial intelligence, especially natural language processing (NLP). Recently, inspired by the success of pre-trained language models (PLMs) in the generic domain, many LegalAI researchers devote their effort to apply PLMs to legal tasks. However, utilizing PLMs to address legal tasks is still challenging, as the legal documents usually consist of thousands of tokens, which is far longer than the length that mainstream PLMs can process. In this paper, we release the Longformer-based pre-trained language model, named as Lawformer, for Chinese legal long documents understanding. We evaluate Lawformer on a variety of LegalAI tasks, including judgment prediction, similar case retrieval, legal reading comprehension, and legal question answering. The experimental results demonstrate that our model can achieve promising improvement on tasks with long documents as inputs.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

09/13/2022

Pre-training Transformers on Indian Legal Text

Natural Language Processing in the legal domain been benefited hugely by...
04/25/2020

How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence

Legal Artificial Intelligence (LegalAI) focuses on applying the technolo...
10/11/2022

Legal Element-oriented Modeling with Multi-view Contrastive Learning for Legal Case Retrieval

Legal case retrieval, which aims to retrieve relevant cases given a quer...
11/02/2022

Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformer

Pre-trained Transformers currently dominate most NLP tasks. They impose,...
11/10/2019

Searching for Legal Clauses by Analogy. Few-shot Semantic Retrieval Shared Task

We introduce a novel shared task for semantic retrieval from legal texts...
11/16/2021

An Empirical Study of Finding Similar Exercises

Education artificial intelligence aims to profit tasks in the education ...
09/18/2018

Automatic Judgment Prediction via Legal Reading Comprehension

Automatic judgment prediction aims to predict the judicial results based...