Speakers account for asymmetries in visual perspective so listeners don't have to

07/24/2018
by   Robert X. D. Hawkins, et al.
0

Debates over adults' theory of mind use have been fueled by surprising failures of visual perspective-taking in simple communicative tasks. Motivated by recent computational models of context-sensitive language use, we reconsider the evidence in light of the nuanced pragmatics of these tasks: the differential informativity expected of a speaker depending on the context. Our model predicts that cooperative speakers faced with asymmetries in visual access ought to adjust their utterances to be more informative. In Exp. 1, we explicitly manipulated the presence or absence of occlusions and found that speakers systematically produced longer, more specific referring expressions than required given their own view when they have uncertainty about what their partner is seeing. In Exp. 2, we compare the utterances used by confederates in prior work with those produced by unscripted speakers in the same task. We find that confederates are systematically less informative than expected, leading to more listener errors. In addition to demonstrating a sophisticated form of speaker perspective-taking, these results suggest a deeper pragmatic explanation for why listeners may sometimes neglect to consider visual perspective: Failures of visual perspective-taking may in fact be explained by sophisticated pragmatic expectations about communicative behavior---that is, to successful use of theory of mind.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

page 20

page 21

research
05/31/2023

Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind

Dialogue participants may have varying levels of knowledge about the top...
research
11/15/2018

Effect of data reduction on sequence-to-sequence neural TTS

Recent speech synthesis systems based on sampling from autoregressive ne...
research
12/07/2021

A pragmatic account of the weak evidence effect

Language is not only used to inform. We often seek to persuade by arguin...
research
05/18/2022

Color Overmodification Emerges from Data-Driven Learning and Pragmatic Reasoning

Speakers' referential expressions often depart from communicative ideals...
research
01/25/2021

Open-Mindedness and Style Coordination in Argumentative Discussions

Linguistic accommodation is the process in which speakers adjust their a...
research
05/08/2018

Comparing heterogeneous visual gestures for measuring the diversity of visual speech signals

Visual lip gestures observed whilst lipreading have a few working defini...
research
08/27/2020

Estimating Uniqueness of Human Voice UsingI-Vector Representation

We study the individuality of human voice with re-spect to a widely used...

Please sign up or login with your details

Forgot password? Click here to reset