Emotional State Categorization from Speech: Machine vs. Human

09/01/2010
by   Arslan Shaukat, et al.
0

This paper presents our investigations on emotional state categorization from speech signals with a psychologically inspired computational model against human performance under the same experimental setup. Based on psychological studies, we propose a multistage categorization strategy which allows establishing an automatic categorization model flexibly for a given emotional speech categorization task. We apply the strategy to the Serbian Emotional Speech Corpus (GEES) and the Danish Emotional Speech Corpus (DES), where human performance was reported in previous psychological studies. Our work is the first attempt to apply machine learning to the GEES corpus where the human recognition rates were only available prior to our study. Unlike the previous work on the DES corpus, our work focuses on a comparison to human performance under the same experimental settings. Our studies suggest that psychology-inspired systems yield behaviours that, to a great extent, resemble what humans perceived and their performance is close to that of humans under the same experimental setup. Furthermore, our work also uncovers some differences between machine and humans in terms of emotional state recognition from speech.

READ FULL TEXT
research
09/25/2017

Towards Indonesian Speech-Emotion Automatic Recognition (I-SpEAR)

Even though speech-emotion recognition (SER) has been receiving much att...
research
08/30/2018

MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels

Emotion shapes all aspects of our interpersonal and intellectual experie...
research
05/18/2022

Features of Perceived Metaphoricity on the Discourse Level: Abstractness and Emotionality

Research on metaphorical language has shown ties between abstractness an...
research
04/22/2017

Learning Representations of Emotional Speech with Deep Convolutional Generative Adversarial Networks

Automatically assessing emotional valence in human speech has historical...
research
11/15/2021

Biologically inspired speech emotion recognition

Conventional feature-based classification methods do not apply well to a...
research
12/20/2019

SensAI+Expanse Adaptation on Human Behaviour Towards Emotional Valence Prediction

An agent, artificial or human, must be continuously adjusting its behavi...
research
01/03/2020

SensAI+Expanse Emotional Valence Prediction Studies with Cognition and Memory Integration

The humans are affective and cognitive beings relying on memories for th...

Please sign up or login with your details

Forgot password? Click here to reset