An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wild

10/07/2020

∙

In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer learning approaches, we reached a test set challenge performance measure of 42.10

READ FULL TEXT

An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wild

Expression Recognition Analysis in the Wild

Investigation of Multimodal Features, Classifiers and Fusion Methods for Emotion Recognition

Aff-Wild Database and AffWildNet

Deep Impression: Audiovisual Deep Residual Networks for Multimodal Apparent Personality Trait Recognition

Do Deep Neural Networks Forget Facial Action Units? – Exploring the Effects of Transfer Learning in Health Related Facial Expression Recognition

EmoNets: Multimodal deep learning approaches for emotion recognition in video

EMOPAIN Challenge 2020: Multimodal Pain Evaluation from Facial and Bodily Expressions

An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wild

Related Research

Expression Recognition Analysis in the Wild

Investigation of Multimodal Features, Classifiers and Fusion Methods for Emotion Recognition

Aff-Wild Database and AffWildNet

Deep Impression: Audiovisual Deep Residual Networks for Multimodal Apparent Personality Trait Recognition

Do Deep Neural Networks Forget Facial Action Units? – Exploring the Effects of Transfer Learning in Health Related Facial Expression Recognition

EmoNets: Multimodal deep learning approaches for emotion recognition in video

EMOPAIN Challenge 2020: Multimodal Pain Evaluation from Facial and Bodily Expressions