Interpretable Deep Neural Networks for Dimensional and Categorical Emotion Recognition in-the-wild

10/13/2019

∙

Emotions play an important role in people's life. Understanding and recognising is not only important for interpersonal communication, but also has promising applications in Human-Computer Interaction, automobile safety and medical research. This project focuses on extending the emotion recognition database, and training the CNN + RNN emotion recognition neural networks with emotion category representation and valence & arousal representation. The combined models are constructed by training the two representations simultaneously. The comparison and analysis between the three types of model are discussed. The inner-relationship between two emotion representations and the interpretability of the neural networks are investigated. The findings suggest that categorical emotion recognition performance can benefit from training with a combined model. And the mapping of emotion category and valence & arousal values can explain this phenomenon.

READ FULL TEXT

Interpretable Deep Neural Networks for Dimensional and Categorical Emotion Recognition in-the-wild

A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wild

Training speech emotion classifier without categorical annotations

Morphset:Augmenting categorical emotion datasets with dimensional affect labels using face morphing

Interpretable Deep Neural Networks for Facial Expression and Dimensional Emotion Recognition in-the-wild

Emotion Recognition in the Wild using Deep Neural Networks and Bayesian Classifiers

Training Deep Neural Networks with Different Datasets In-the-wild: The Emotion Recognition Paradigm

Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Dataset

Interpretable Deep Neural Networks for Dimensional and Categorical Emotion Recognition in-the-wild

Related Research

A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wild

Training speech emotion classifier without categorical annotations

Morphset:Augmenting categorical emotion datasets with dimensional affect labels using face morphing

Interpretable Deep Neural Networks for Facial Expression and Dimensional Emotion Recognition in-the-wild

Emotion Recognition in the Wild using Deep Neural Networks and Bayesian Classifiers

Training Deep Neural Networks with Different Datasets In-the-wild: The Emotion Recognition Paradigm

Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Dataset