Harnessing the richness of the linguistic signal in predicting pragmatic inferences

10/31/2019
by   Sebastian Schuster, et al.
0

The strength of pragmatic inferences systematically depends on linguistic and contextual cues. For example, the presence of a partitive construction increases the strength of a so-called scalar inference: humans perceive the inference that Chris did not eat all of the cookies to be stronger after hearing "Chris ate some of the cookies" than after hearing the same utterance without a partitive, "Chris ate some cookies". In this work, we explore to what extent it is possible to learn associations between linguistic cues and inference strength ratings without direct supervision. We show that an LSTM-based sentence encoder with an attention mechanism trained on a dataset of human inference strength ratings is able to predict ratings with high accuracy (r=0.78). We probe the model's behavior in multiple analyses using corpus data and manually constructed minimal pairs and find that the model learns associations between linguistic cues and scalar inferences, suggesting that these associations are inferable from statistical input.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/24/2020

Statistical Discrimination in Ratings-Guided Markets

We study statistical discrimination of individuals based on payoff-irrel...
research
03/10/2022

Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in context

Most large language models are trained on linguistic input alone, yet hu...
research
01/26/2021

Exploring Transitivity in Neural NLI Models through Veridicality

Despite the recent success of deep neural networks in natural language p...
research
07/21/2017

Multichannel Attention Network for Analyzing Visual Behavior in Public Speaking

Public speaking is an important aspect of human communication and intera...
research
05/24/2023

ChatGPT and Simple Linguistic Inferences: Blind Spots and Blinds

This paper sheds light on the limitations of ChatGPT's understanding cap...
research
05/19/2022

Acceptability Judgements via Examining the Topology of Attention Maps

The role of the attention mechanism in encoding linguistic knowledge has...
research
04/07/2023

Expectations over Unspoken Alternatives Predict Pragmatic Inferences

Scalar inferences (SI) are a signature example of how humans interpret l...

Please sign up or login with your details

Forgot password? Click here to reset