Embedded Emotions – A Data Driven Approach to Learn Transferable Feature Representations from Raw Speech Input for Emotion Recognition

by   Dominik Schiller, et al.

Traditional approaches to automatic emotion recognition are relying on the application of handcrafted features. More recently however the advent of deep learning enabled algorithms to learn meaningful representations of input data automatically. In this paper, we investigate the applicability of transferring knowledge learned from large text and audio corpora to the task of automatic emotion recognition. To evaluate the practicability of our approach, we are taking part in this year's Interspeech ComParE Elderly Emotion Sub-Challenge, where the goal is to classify spoken narratives of elderly people with respect to the emotion of the speaker. Our results show that the learned feature representations can be effectively applied for classifying emotions from spoken language. We found the performance of the features extracted from the audio signal to be not as consistent as those that have been extracted from the transcripts. While the acoustic features achieved best in class results on the development set, when compared to the baseline systems, their performance dropped considerably on the test set of the challenge. The features extracted from the text form, however, are showing promising results on both sets and are outperforming the official baseline by 5.7 percentage points unweighted average recall.



There are no comments yet.


page 1

page 2

page 3

page 4


Investigation of Multimodal Features, Classifiers and Fusion Methods for Emotion Recognition

Automatic emotion recognition is a challenging task. In this paper, we p...

x-vectors meet emotions: A study on dependencies between emotion and speaker recognition

In this work, we explore the dependencies between speaker recognition an...

Classification of Emotions and Evaluation of Customer Satisfaction from Speech in Real World Acoustic Environments

This paper focuses on finding suitable features to robustly recognize em...

Towards Multimodal Emotion Recognition in German Speech Events in Cars using Transfer Learning

The recognition of emotions by humans is a complex process which conside...

Towards Interpretable and Transferable Speech Emotion Recognition: Latent Representation Based Analysis of Features, Methods and Corpora

In recent years, speech emotion recognition (SER) has been used in wide ...

Depression Severity Estimation from Multiple Modalities

Depression is a major debilitating disorder which can affect people from...

Emotion Analysis of Songs Based on Lyrical and Audio Features

In this paper, a method is proposed to detect the emotion of a song base...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.