DeepAI AI Chat
Log In Sign Up

Modeling Preconditions in Text with a Crowd-sourced Dataset

10/06/2020
by   Heeyoung Kwon, et al.
0

Preconditions provide a form of logical connection between events that explains why some events occur together and information that is complementary to the more widely studied relations such as causation, temporal ordering, entailment, and discourse relations. Modeling preconditions in text has been hampered in part due to the lack of large scale labeled data grounded in text. This paper introduces PeKo, a crowd-sourced annotation of preconditions between event pairs in newswire, an order of magnitude larger than prior text annotations. To complement this new corpus, we also introduce two challenge tasks aimed at modeling preconditions: (i) Precondition Identification – a standard classification task defined over pairs of event mentions, and (ii) Precondition Generation – a generative task aimed at testing a more general ability to reason about a given event. Evaluation on both tasks shows that modeling preconditions is challenging even for today's large language models (LM). This suggests that precondition knowledge is not easily accessible in LM-derived representations alone. Our generation results show that fine-tuning an LM on PeKo yields better conditional relations than when trained on raw text or temporally-ordered corpora.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/31/2020

Conditional Generation of Temporally-ordered Event Sequences

Models encapsulating narrative schema knowledge have proven to be useful...
04/16/2022

Probing Script Knowledge from Pre-Trained Models

Script knowledge is critical for humans to understand the broad daily ta...
04/26/2020

Assessing Discourse Relations in Language Generation from Pre-trained Language Models

Recent advances in NLP have been attributed to the emergence of large-sc...
04/26/2020

Assessing Discourse Relations in Language Generationfrom Pre-trained Language Models

Recent advances in NLP have been attributed to the emergence of large-sc...
10/24/2020

Temporal Reasoning on Implicit Events from Distant Supervision

Existing works on temporal reasoning among events described in text focu...
09/02/2019

Minimally Supervised Learning of Affective Events Using Discourse Relations

Recognizing affective events that trigger positive or negative sentiment...
03/01/2016

Event Search and Analytics: Detecting Events in Semantically Annotated Corpora for Search and Analytics

In this article, I present the questions that I seek to answer in my PhD...