MAVEN: A Massive General Domain Event Detection Dataset

04/28/2020
by   Xiaozhi Wang, et al.
0

Event detection (ED), which identifies event trigger words and classifies event types according to contexts, is the first and most fundamental step for extracting event knowledge from plain text. Most existing datasets exhibit the following issues that limit further development of ED: (1) Small scale of existing datasets is not sufficient for training and stably benchmarking increasingly sophisticated modern neural methods. (2) Limited event types of existing datasets lead to the trained models cannot be easily adapted to general-domain scenarios. To alleviate these problems, we present a MAssive eVENt detection dataset (MAVEN), which contains 4,480 Wikipedia documents, 117,200 event mention instances, and 207 event types. MAVEN alleviates the lack of data problem and covers much more general event types. Besides the dataset, we reproduce the recent state-of-the-art ED models and conduct a thorough evaluation for these models on MAVEN. The experimental results and empirical analyses show that existing ED methods cannot achieve promising results as on the small datasets, which suggests ED in real world remains a challenging task and requires further research efforts. The dataset and baseline code will be released in the future to promote this field.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/16/2022

LEVEN: A Large-Scale Chinese Legal Event Detection Dataset

Recognizing facts is the most fundamental step in making judgments, henc...
research
11/02/2022

Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset

Event extraction (EE) is crucial to downstream tasks such as new aggrega...
research
11/25/2022

MUSIED: A Benchmark for Event Detection from Multi-Source Heterogeneous Informal Texts

Event detection (ED) identifies and classifies event triggers from unstr...
research
03/16/2023

GLEN: General-Purpose Event Detection for Thousands of Types

The development of event extraction systems has been hindered by the abs...
research
04/11/2021

WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia

Cross-document event coreference resolution is a foundational task for N...
research
10/24/2019

Extending Event Detection to New Types with Learning from Keywords

Traditional event detection classifies a word or a phrase in a given sen...
research
04/24/2019

Appliance Event Detection – A Multivariate, Supervised Classification Approach

Non-intrusive load monitoring (NILM) is a modern and still expanding tec...

Please sign up or login with your details

Forgot password? Click here to reset