Searching for Legal Clauses by Analogy. Few-shot Semantic Retrieval Shared Task

11/10/2019
by   Łukasz Borchmann, et al.
0

We introduce a novel shared task for semantic retrieval from legal texts, where one is expected to perform a so-called contract discovery – extract specified legal clauses from documents given a few examples of similar clauses from other legal acts. The task differs substantially from conventional NLI and legal information extraction shared tasks. Its specification is followed with evaluation of multiple k-NN based solutions within the unified framework proposed for this branch of methods. It is shown that state-of-the-art pre-trained encoders fail to provide satisfactory results on the task proposed, whereas Language Model based solutions perform well, especially when unsupervised fine-tuning is applied. In addition to the ablation studies, the questions regarding relevant text fragments detection accuracy depending on number of examples available were addressed. In addition to dataset and reference results, legal-specialized LMs were made publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/22/2023

SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrieval

Legal case retrieval, which aims to find relevant cases for a query case...
research
06/13/2022

Indian Legal Text Summarization: A Text Normalisation-based Approach

In the Indian court system, pending cases have long been a problem. Ther...
research
12/05/2022

Legal Prompt Engineering for Multilingual Legal Judgement Prediction

Legal Prompt Engineering (LPE) or Legal Prompting is a process to guide ...
research
05/09/2023

CaseEncoder: A Knowledge-enhanced Pre-trained Model for Legal Case Encoding

Legal case retrieval is a critical process for modern legal information ...
research
08/04/2023

Legal Summarisation through LLMs: The PRODIGIT Project

We present some initial results of a large-scale Italian project called ...
research
10/20/2020

A Benchmark for Lease Contract Review

Extracting entities and other useful information from legal contracts is...
research
05/30/2019

Threshold-Based Retrieval and Textual Entailment Detection on Legal Bar Exam Questions

Getting an overview over the legal domain has become challenging, especi...

Please sign up or login with your details

Forgot password? Click here to reset