Legal Prompt Engineering for Multilingual Legal Judgement Prediction

12/05/2022
by   Dietrich Trautmann, et al.
17

Legal Prompt Engineering (LPE) or Legal Prompting is a process to guide and assist a large language model (LLM) with performing a natural legal language processing (NLLP) skill. Our goal is to use LPE with LLMs over long legal documents for the Legal Judgement Prediction (LJP) task. We investigate the performance of zero-shot LPE for given facts in case-texts from the European Court of Human Rights (in English) and the Federal Supreme Court of Switzerland (in German, French and Italian). Our results show that zero-shot LPE is better compared to the baselines, but it still falls short compared to current state of the art supervised approaches. Nevertheless, the results are important, since there was 1) no explicit domain-specific data used - so we show that the transfer to the legal domain is possible for general-purpose LLMs, and 2) the LLMs where directly applied without any further training or fine-tuning - which in turn saves immensely in terms of additional computational costs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/02/2022

Legal Prompting: Teaching a Language Model to Think Like a Lawyer

Large language models that are capable of zero or few-shot prompting app...
research
05/08/2023

Unlocking Practical Applications in Legal Domain: Evaluation of GPT for Zero-Shot Semantic Annotation of Legal Texts

We evaluated the capability of a state-of-the-art generative pre-trained...
research
02/01/2023

Zero-shot Transfer of Article-aware Legal Outcome Classification for European Court of Human Rights Cases

In this paper, we cast Legal Judgment Prediction on European Court of Hu...
research
09/15/2023

Resolving Legalese: A Multilingual Exploration of Negation Scope Resolution in Legal Documents

Resolving the scope of a negation within a sentence is a challenging NLP...
research
08/08/2023

Large Language Model Prompt Chaining for Long Legal Document Classification

Prompting is used to guide or steer a language model in generating an ap...
research
11/10/2019

Searching for Legal Clauses by Analogy. Few-shot Semantic Retrieval Shared Task

We introduce a novel shared task for semantic retrieval from legal texts...
research
11/03/2022

Data-efficient End-to-end Information Extraction for Statistical Legal Analysis

Legal practitioners often face a vast amount of documents. Lawyers, for ...

Please sign up or login with your details

Forgot password? Click here to reset