Speaker attribution in German parliamentary debates with QLoRA-adapted large language models

09/18/2023
by   Tobias Bornheim, et al.
0

The growing body of political texts opens up new opportunities for rich insights into political dynamics and ideologies but also increases the workload for manual analysis. Automated speaker attribution, which detects who said what to whom in a speech event and is closely related to semantic role labeling, is an important processing step for computational text analysis. We study the potential of the large language model family Llama 2 to automate speaker attribution in German parliamentary debates from 2017-2021. We fine-tune Llama 2 with QLoRA, an efficient training strategy, and observe our approach to achieve competitive performance in the GermEval 2023 Shared Task On Speaker Attribution in German News Articles and Parliamentary Debates. Our results shed light on the capabilities of large language models in automating speaker attribution, revealing a promising avenue for computational analysis of political discourse and the development of semantic role labeling systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/07/2023

Improving Automatic Quotation Attribution in Literary Novels

Current models for quotation attribution in literary novels assume varyi...
research
10/17/2022

RARR: Researching and Revising What Language Models Say, Using Language Models

Language models (LMs) now excel at many tasks such as few-shot learning,...
research
10/16/2019

Right-wing German Hate Speech on Twitter: Analysis and Automatic Detection

Discussion about the social network Twitter often concerns its role in p...
research
05/10/2023

Automatic Evaluation of Attribution by Large Language Models

A recent focus of large language model (LLM) development, as exemplified...
research
02/11/2023

Characterizing Attribution and Fluency Tradeoffs for Retrieval-Augmented Large Language Models

Despite recent progress, it has been difficult to prevent semantic hallu...
research
02/24/2016

Domain Specific Author Attribution Based on Feedforward Neural Network Language Models

Authorship attribution refers to the task of automatically determining t...

Please sign up or login with your details

Forgot password? Click here to reset