A Discriminative Acoustic-Prosodic Approach for Measuring Local Entrainment

04/23/2018
by   Megan M. Willi, et al.
0

Acoustic-prosodic entrainment describes the tendency of humans to align or adapt their speech acoustics to each other in conversation. This alignment of spoken behavior has important implications for conversational success. However, modeling the subtle nature of entrainment in spoken dialogue continues to pose a challenge. In this paper, we propose a straightforward definition for local entrainment in the speech domain and operationalize an algorithm based on this: acoustic-prosodic features that capture entrainment should be maximally different between real conversations involving two partners and sham conversations generated by randomly mixing the speaking turns from the original two conversational partners. We propose an approach for measuring local entrainment that quantifies alignment of behavior on a turn-by-turn basis, projecting the differences between interlocutors' acoustic-prosodic features for a given turn onto a discriminative feature subspace that maximizes the difference between real and sham conversations. We evaluate the method using the derived features to drive a classifier aiming to predict an objective measure of conversational success (i.e., low versus high), on a corpus of task-oriented conversations. The proposed entrainment approach achieves 72 classification accuracy using a Naive Bayes classifier, outperforming three previously established approaches evaluated on the same conversational corpus.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2021

Controllable Context-aware Conversational Speech Synthesis

In spoken conversations, spontaneous behaviors like filled pause and pro...
research
05/13/2017

Annotating and Modeling Empathy in Spoken Conversations

Empathy, as defined in behavioral sciences, expresses the ability of hum...
research
04/23/2018

Towards an Unsupervised Entrainment Distance in Conversational Speech using Deep Neural Networks

Entrainment is a known adaptation mechanism that causes interaction part...
research
06/17/2022

What can Speech and Language Tell us About the Working Alliance in Psychotherapy

We are interested in the problem of conversational analysis and its appl...
research
03/28/2019

Modeling Acoustic-Prosodic Cues for Word Importance Prediction in Spoken Dialogues

Prosodic cues in conversational speech aid listeners in discerning a mes...
research
12/28/2017

On the Challenges of Detecting Rude Conversational Behaviour

In this study, we aim to identify moments of rudeness between two indivi...
research
08/06/2018

Paying Attention to Attention: Highlighting Influential Samples in Sequential Analysis

In (Yang et al. 2016), a hierarchical attention network (HAN) is created...

Please sign up or login with your details

Forgot password? Click here to reset