Quantifying the perceptual value of lexical and non-lexical channels in speech

07/07/2023
by   Sarenne Wallbridge, et al.
0

Speech is a fundamental means of communication that can be seen to provide two channels for transmitting information: the lexical channel of which words are said, and the non-lexical channel of how they are spoken. Both channels shape listener expectations of upcoming communication; however, directly quantifying their relative effect on expectations is challenging. Previous attempts require spoken variations of lexically-equivalent dialogue turns or conspicuous acoustic manipulations. This paper introduces a generalised paradigm to study the value of non-lexical information in dialogue across unconstrained lexical content. By quantifying the perceptual value of the non-lexical channel with both accuracy and entropy reduction, we show that non-lexical information produces a consistent effect on expectations of upcoming dialogue: even when it leads to poorer discriminative turn judgements than lexical content alone, it yields higher consensus among participants.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/01/2021

It's not what you said, it's how you said it: discriminative perception of speech as a multichannel communication system

People convey information extremely effectively through spoken interacti...
research
07/25/2019

What's in an accent? The impact of accented synthetic speech on lexical choice in human-machine dialogue

The assumptions we make about a dialogue partner's knowledge and communi...
research
09/30/2017

Confirmation detection in human-agent interaction using non-lexical speech cues

Even if only the acoustic channel is considered, human communication is ...
research
09/27/2022

Interactivism in Spoken Dialogue Systems

The interactivism model introduces a dynamic approach to language, commu...
research
11/17/2017

Phonological (un)certainty weights lexical activation

Spoken word recognition involves at least two basic computations. First ...
research
11/25/2018

A Method for Analysis of Patient Speech in Dialogue for Dementia Detection

We present an approach to automatic detection of Alzheimer's type dement...

Please sign up or login with your details

Forgot password? Click here to reset