CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction

05/01/2022
by   Jiaju Lin, et al.
0

Implicit event argument extraction (EAE) aims to identify arguments that could scatter over the document. Most previous work focuses on learning the direct relations between arguments and the given trigger, while the implicit relations with long-range dependency are not well studied. Moreover, recent neural network based approaches rely on a large amount of labeled data for training, which is unavailable due to the high labelling cost. In this paper, we propose a Curriculum learning based Prompt tuning (CUP) approach, which resolves implicit EAE by four learning stages. The stages are defined according to the relations with the trigger node in a semantic graph, which well captures the long-range dependency between arguments and the trigger. In addition, we integrate a prompt-based encoder-decoder model to elicit related knowledge from pre-trained language models (PLMs) in each stage, where the prompt templates are adapted with the learning progress to enhance the reasoning for arguments. Experimental results on two well-known benchmark datasets show the great advantages of our proposed approach. In particular, we outperform the state-of-the-art models in both fully-supervised and low-data scenarios.

READ FULL TEXT
research
09/11/2021

Eliciting Knowledge from Language Models for Event Extraction

Eliciting knowledge contained in language models via prompt-based learni...
research
10/06/2020

Resource-Enhanced Neural Model for Event Argument Extraction

Event argument extraction (EAE) aims to identify the arguments of an eve...
research
08/27/2022

A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck

Event argument extraction (EAE) aims to extract arguments with given rol...
research
02/20/2018

Implicit Argument Prediction with Event Knowledge

Implicit arguments are not syntactically connected to their predicates, ...
research
03/19/2020

Joint Event Extraction along Shortest Dependency Paths using Graph Convolutional Networks

Event extraction (EE) is one of the core information extraction tasks, w...
research
09/15/2020

Critical Thinking for Language Models

This paper takes a first step towards a critical thinking curriculum for...
research
01/25/2021

Process-Level Representation of Scientific Protocols with Interactive Annotation

We develop Process Execution Graphs (PEG), a document-level representati...

Please sign up or login with your details

Forgot password? Click here to reset