Automatic Detection of Expressed Emotion from Five-Minute Speech Samples: Challenges and Opportunities

03/30/2022
by   Bahman Mirheidari, et al.
0

We present a novel feasibility study on the automatic recognition of Expressed Emotion (EE), a family environment concept based on caregivers speaking freely about their relative/family member. We describe an automated approach for determining the degree of warmth, a key component of EE, from acoustic and text features acquired from a sample of 37 recorded interviews. These recordings, collected over 20 years ago, are derived from a nationally representative birth cohort of 2,232 British twin children and were manually coded for EE. We outline the core steps of extracting usable information from recordings with highly variable audio quality and assess the efficacy of four machine learning approaches trained with different combinations of acoustic and text features. Despite the challenges of working with this legacy data, we demonstrated that the degree of warmth can be predicted with an F_1-score of 61.5%. In this paper, we summarise our learning and provide recommendations for future work using real-world speech samples.

READ FULL TEXT
research
07/01/2020

Automated Empathy Detection for Oncology Encounters

Empathy involves understanding other people's situation, perspective, an...
research
10/20/2020

Replacing Human Audio with Synthetic Audio for On-device Unspoken Punctuation Prediction

We present a novel multi-modal unspoken punctuation prediction system fo...
research
10/26/2022

Two-stage dimensional emotion recognition by fusing predictions of acoustic and text networks using SVM

Automatic speech emotion recognition (SER) by a computer is a critical c...
research
01/04/2022

Classifying Autism from Crowdsourced Semi-Structured Speech Recordings: A Machine Learning Approach

Autism spectrum disorder (ASD) is a neurodevelopmental disorder which re...
research
06/19/2018

The PRIORI Emotion Dataset: Linking Mood to Emotion Detected In-the-Wild

Bipolar Disorder is a chronic psychiatric illness characterized by patho...
research
07/01/2022

Affordance Extraction with an External Knowledge Database for Text-Based Simulated Environments

Text-based simulated environments have proven to be a valid testbed for ...

Please sign up or login with your details

Forgot password? Click here to reset