Emo-CNN for Perceiving Stress from Audio Signals: A Brain Chemistry Approach

01/08/2020
by   Anup Anand Deshmukh, et al.
0

Emotion plays a key role in many applications like healthcare, to gather patients emotional behavior. There are certain emotions which are given more importance due to their effectiveness in understanding human feelings. In this paper, we propose an approach that models human stress from audio signals. The research challenge in speech emotion detection is defining the very meaning of stress and being able to categorize it in a precise manner. Supervised Machine Learning models, including state of the art Deep Learning classification methods, rely on the availability of clean and labelled data. One of the problems in affective computation and emotion detection is the limited amount of annotated data of stress. The existing labelled stress emotion datasets are highly subjective to the perception of the annotator. We address the first issue of feature selection by exploiting the use of traditional MFCC features in Convolutional Neural Network. Our experiments show that Emo-CNN consistently and significantly outperforms the popular existing methods over multiple datasets. It achieves 90.2 Emo-DB dataset. To tackle the second and the more significant problem of subjectivity in stress labels, we use Lovheim's cube, which is a 3-dimensional projection of emotions. The cube aims at explaining the relationship between these neurotransmitters and the positions of emotions in 3D space. The learnt emotion representations from the Emo-CNN are mapped to the cube using three component PCA (Principal Component Analysis) which is then used to model human stress. This proposed approach not only circumvents the need for labelled stress data but also complies with the psychological theory of emotions given by Lovheim's cube. We believe that this work is the first step towards creating a connection between Artificial Intelligence and the chemistry of human emotions.

READ FULL TEXT
research
08/23/2019

Controlling for Confounders in Multimodal Emotion Classification via Adversarial Learning

Various psychological factors affect how individuals express emotions. Y...
research
08/28/2023

A Comparison of Personalized and Generalized Approaches to Emotion Recognition Using Consumer Wearable Devices: Machine Learning Study

Background: Studies have shown the potential adverse health effects, ran...
research
10/26/2021

DASentimental: Detecting depression, anxiety and stress in texts via emotional recall, cognitive networks and machine learning

Most current affect scales and sentiment analysis on written text focus ...
research
05/17/2021

MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary Task

The capability to automatically detect human stress can benefit artifici...
research
08/22/2018

Finding Good Representations of Emotions for Text Classification

It is important for machines to interpret human emotions properly for be...
research
06/21/2020

Human Emotion Detection from Audio and Video Signals

The primary objective is to teach a machine about human emotions, which ...
research
07/12/2021

Stress Classification and Personalization: Getting the most out of the least

Stress detection and monitoring is an active area of research with impor...

Please sign up or login with your details

Forgot password? Click here to reset