Decoupling entrainment from consistency using deep neural networks

11/03/2020
by   Andreas Weise, et al.
0

Human interlocutors tend to engage in adaptive behavior known as entrainment to become more similar to each other. Isolating the effect of consistency, i.e., speakers adhering to their individual styles, is a critical part of the analysis of entrainment. We propose to treat speakers' initial vocal features as confounds for the prediction of subsequent outputs. Using two existing neural approaches to deconfounding, we define new measures of entrainment that control for consistency. These successfully discriminate real interactions from fake ones. Interestingly, our stricter methods correlate with social variables in opposite direction from previous measures that do not account for consistency. These results demonstrate the advantages of using neural networks to model entrainment, and raise questions regarding how to interpret prior associations of conversation quality with entrainment measures that do not account for consistency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2021

Learning from My Friends: Few-Shot Personalized Conversation Systems via Social Networks

Personalized conversation models (PCMs) generate responses according to ...
research
09/27/2020

Defining and Quantifying Conversation Quality in Spontaneous Interactions

Social interactions in general are multifaceted and there exists a wide ...
research
09/07/2020

Representativity and Consistency Measures for Deep Neural Network Explanations

The adoption of machine learning in critical contexts requires a reliabl...
research
03/11/2018

Path of Vowel Raising in Chengdu Dialect of Mandarin

He and Rao (2013) reported a raising phenomenon of /a/ in /Xan/ (X being...
research
05/24/2022

SepIt: Approaching a Single Channel Speech Separation Bound

We present an upper bound for the Single Channel Speech Separation task,...
research
11/13/2020

Wisdom of the Ensemble: Improving Consistency of Deep Learning Models

Deep learning classifiers are assisting humans in making decisions and h...
research
10/30/2020

Adapting Neural Networks for Uplift Models

Uplift is a particular case of individual treatment effect modeling. Suc...

Please sign up or login with your details

Forgot password? Click here to reset