NOPE: A Corpus of Naturally-Occurring Presuppositions in English

09/14/2021
by   Alicia Parrish, et al.
0

Understanding language requires grasping not only the overtly stated content, but also making inferences about things that were left unsaid. These inferences include presuppositions, a phenomenon by which a listener learns about new information through reasoning about what a speaker takes as given. Presuppositions require complex understanding of the lexical and syntactic properties that trigger them as well as the broader conversational context. In this work, we introduce the Naturally-Occurring Presuppositions in English (NOPE) Corpus to investigate the context-sensitivity of 10 different types of presupposition triggers and to evaluate machine learning models' ability to predict human inferences. We find that most of the triggers we investigate exhibit moderate variability. We further find that transformer-based models draw correct inferences in simple cases involving presuppositions, but they fail to capture the minority of exceptional cases in which human judgments reveal complex interactions between context and triggers.

READ FULL TEXT

page 3

page 5

page 8

page 17

research
08/14/2019

The lexical and grammatical sources of neg-raising inferences

We investigate neg(ation)-raising inferences, wherein negation on a pred...
research
08/19/2018

Lexicosyntactic Inference in Neural Models

We investigate neural models' ability to capture lexicosyntactic inferen...
research
04/28/2021

Learning Syntax from Naturally-Occurring Bracketings

Naturally-occurring bracketings, such as answer fragments to natural lan...
research
10/05/2020

Investigating representations of verb bias in neural language models

Languages typically provide more than one grammatical construction to ex...
research
05/06/2018

Breaking NLI Systems with Sentences that Require Simple Lexical Inferences

We create a new NLI test set that shows the deficiency of state-of-the-a...
research
05/24/2022

Partial-input baselines show that NLI models can ignore context, but they don't

When strong partial-input baselines reveal artifacts in crowdsourced NLI...
research
10/18/2019

Towards Computing Inferences from English News Headlines

Newspapers are a popular form of written discourse, read by many people,...

Please sign up or login with your details

Forgot password? Click here to reset