Context-aware Cascade Attention-based RNN for Video Emotion Recognition

05/30/2018
by   Man-Chin Sun, et al.
0

Emotion recognition can provide crucial information about the user in many applications when building human-computer interaction (HCI) systems. Most of current researches on visual emotion recognition are focusing on exploring facial features. However, context information including surrounding environment and human body can also provide extra clues to recognize emotion more accurately. Inspired by "sequence to sequence model" for neural machine translation, which models input and output sequences by an encoder and a decoder in recurrent neural network (RNN) architecture respectively, a novel architecture, "CACA-RNN", is proposed in this work. The proposed network consists of two RNNs in a cascaded architecture to process both context and facial information to perform video emotion classification. Results of the model were submitted to video emotion recognition sub-challenge in Multimodal Emotion Recognition Challenge (MEC2017). CACA-RNN outperforms the MEC2017 baseline (mAP of 21.7 video only challenge.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2018

A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wild

This paper presents our approach to the One-Minute Gradual-Emotion Recog...
research
01/26/2021

Developing emotion recognition for video conference software to support people with autism

We develop an emotion recognition software for the use with a video conf...
research
05/03/2018

Dimensional emotion recognition using visual and textual cues

This paper addresses the problem of automatic emotion recognition in the...
research
07/07/2021

An audiovisual and contextual approach for categorical and continuous emotion recognition in-the-wild

In this work we tackle the task of video-based audio-visual emotion reco...
research
04/27/2019

Human-Centered Emotion Recognition in Animated GIFs

As an intuitive way of expression emotion, the animated Graphical Interc...
research
09/10/2017

Robust Emotion Recognition from Low Quality and Low Bit Rate Video: A Deep Learning Approach

Emotion recognition from facial expressions is tremendously useful, espe...
research
07/28/2022

Extending RNN-T-based speech recognition systems with emotion and language classification

Speech transcription, emotion recognition, and language identification a...

Please sign up or login with your details

Forgot password? Click here to reset