Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning

05/03/2022
by   Oscar Sainz, et al.
0

Recent work has shown that NLP tasks such as Relation Extraction (RE) can be recasted as Textual Entailment tasks using verbalizations, with strong performance in zero-shot and few-shot settings thanks to pre-trained entailment models. The fact that relations in current RE datasets are easily verbalized casts doubts on whether entailment would be effective in more complex tasks. In this work we show that entailment is also effective in Event Argument Extraction (EAE), reducing the need of manual annotation to 50 and WikiEvents respectively, while achieving the same performance as with full training. More importantly, we show that recasting EAE as entailment alleviates the dependency on schemas, which has been a road-block for transferring annotations between domains. Thanks to the entailment, the multi-source transfer between ACE and WikiEvents further reduces annotation down to 10 5 that the key to good results is the use of several entailment datasets to pre-train the entailment model. Similar to previous approaches, our method requires a small amount of effort for manual verbalization: only less than 15 minutes per event argument type is needed, and comparable results can be achieved with users with different level of expertise.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2021

Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction

Relation extraction systems require large amounts of labeled examples wh...
research
02/09/2023

Global Constraints with Prompting for Zero-Shot Event Argument Classification

Determining the role of event arguments is a crucial subtask of event ex...
research
10/06/2020

Universal Natural Language Processing with Limited Annotations: Try Few-shot Textual Entailment as a Start

A standard way to address different NLP problems is by first constructin...
research
03/25/2022

ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations

The current workflow for Information Extraction (IE) analysts involves t...
research
03/29/2023

Zero-shot Entailment of Leaderboards for Empirical AI Research

We present a large-scale empirical investigation of the zero-shot learni...
research
04/04/2023

EDeR: A Dataset for Exploring Dependency Relations Between Events

Relation extraction is a central task in natural language processing (NL...
research
10/04/2022

Causal Intervention-based Prompt Debiasing for Event Argument Extraction

Prompt-based methods have become increasingly popular among information ...

Please sign up or login with your details

Forgot password? Click here to reset