DeepAI AI Chat
Log In Sign Up

Speech Emotion Recognition via Contrastive Loss under Siamese Networks

by   Zheng Lian, et al.

Speech emotion recognition is an important aspect of human-computer interaction. Prior work proposes various end-to-end models to improve the classification performance. However, most of them rely on the cross-entropy loss together with softmax as the supervision component, which does not explicitly encourage discriminative learning of features. In this paper, we introduce the contrastive loss function to encourage intra-class compactness and inter-class separability between learnable features. Furthermore, multiple feature selection methods and pairwise sample selection methods are evaluated. To verify the performance of the proposed system, we conduct experiments on The Interactive Emotional Dyadic Motion Capture (IEMOCAP) database, a common evaluation corpus. Experimental results reveal the advantages of the proposed method, which reaches 62.19 unweighted accuracy. It outperforms the baseline system that is optimized without the contrastive loss function with 1.14 accuracy and the unweighted accuracy, respectively.


page 1

page 2

page 3

page 4


A pairwise discriminative task for speech emotion recognition

Speech emotion recognition is an important task in human-machine interac...

Contrastive Bi-Projector for Unsupervised Domain Adaption

This paper proposes a novel unsupervised domain adaption (UDA) method ba...

Supervised Contrastive Learning with Nearest Neighbor Search for Speech Emotion Recognition

Speech Emotion Recognition (SER) is a challenging task due to limited da...

End-to-end Triplet Loss based Emotion Embedding System for Speech Emotion Recognition

In this paper, an end-to-end neural embedding system based on triplet lo...

A Graph Isomorphism Network with Weighted Multiple Aggregators for Speech Emotion Recognition

Speech emotion recognition (SER) is an essential part of human-computer ...

Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Data

Electronic Health Record (EHR) data has been of tremendous utility in Ar...