Annotating and Modeling Empathy in Spoken Conversations

05/13/2017
by   Firoj Alam, et al.
0

Empathy, as defined in behavioral sciences, expresses the ability of human beings to recognize, understand and react to emotions, attitudes and beliefs of others. The lack of an operational definition of empathy makes it difficult to measure it. In this paper, we address two related problems in automatic affective behavior analysis: the design of the annotation protocol and the automatic recognition of empathy from spoken conversations. We propose and evaluate an annotation scheme for empathy inspired by the modal model of emotions. The annotation scheme was evaluated on a corpus of real-life, dyadic spoken conversations. In the context of behavioral analysis, we designed an automatic segmentation and classification system for empathy. Given the different speech and language levels of representation where empathy may be communicated, we investigated features derived from the lexical and acoustic spaces. The feature development process was designed to support both the fusion and automatic selection of relevant features from high dimensional space. The automatic classification system was evaluated on call center conversations where it showed significantly better performance than the baseline.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/23/2018

A Discriminative Acoustic-Prosodic Approach for Measuring Local Entrainment

Acoustic-prosodic entrainment describes the tendency of humans to align ...
research
06/17/2022

What can Speech and Language Tell us About the Working Alliance in Psychotherapy

We are interested in the problem of conversational analysis and its appl...
research
08/27/2019

MIDAS: A Dialog Act Annotation Scheme for Open Domain Human Machine Spoken Conversations

Dialog act prediction is an essential language comprehension task for bo...
research
06/11/2021

Spoken Style Learning with Multi-modal Hierarchical Context Encoding for Conversational Text-to-Speech Synthesis

For conversational text-to-speech (TTS) systems, it is vital that the sy...
research
03/08/2019

Fast Prototyping a Dialogue Comprehension System for Nurse-Patient Conversations on Symptom Monitoring

Data for human-human spoken dialogues for research and development are c...
research
04/13/2019

M2H-GAN: A GAN-based Mapping from Machine to Human Transcripts for Speech Understanding

Deep learning is at the core of recent spoken language understanding (SL...
research
12/18/2018

Multiple topic identification in human/human conversations

The paper deals with the automatic analysis of real-life telephone conve...

Please sign up or login with your details

Forgot password? Click here to reset