Speech-Based Emotion Recognition using Neural Networks and Information Visualization

by   Jumana Almahmoud, et al.

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring healthcare professionals to deal with copious amounts of information. Thus, machine learning algorithms can be a useful tool for the classification of emotions. While several models have been developed in this domain, there is a lack of userfriendly representations of the emotion classification systems for therapy. We propose a tool which enables users to take speech samples and identify a range of emotions (happy, sad, angry, surprised, neutral, clam, disgust, and fear) from audio elements through a machine learning model. The dashboard is designed based on local therapists' needs for intuitive representations of speech data in order to gain insights and informative analyses of their sessions with their patients.



There are no comments yet.


page 1

page 2


Emotion Recognition for Healthcare Surveillance Systems Using Neural Networks: A Survey

Recognizing the patient's emotions using deep learning techniques has at...

Predicting Emotions Perceived from Sounds

Sonification is the science of communication of data and events to users...

The Ambiguous World of Emotion Representation

Artificial intelligence and machine learning systems have demonstrated h...

Few-shot Learning in Emotion Recognition of Spontaneous Speech Using a Siamese Neural Network with Adaptive Sample Pair Formation

Speech-based machine learning (ML) has been heralded as a promising solu...

Multi-Classifier Interactive Learning for Ambiguous Speech Emotion Recognition

In recent years, speech emotion recognition technology is of great signi...

Towards Interpretable and Transferable Speech Emotion Recognition: Latent Representation Based Analysis of Features, Methods and Corpora

In recent years, speech emotion recognition (SER) has been used in wide ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.