frame attention networks for facial expression recognition in videos

06/29/2019
by   Debin Meng, et al.
0

The video-based facial expression recognition aims to classify a given video into several basic emotions. How to integrate facial features of individual frames is crucial for this task. In this paper, we propose the Frame Attention Networks (FAN), to automatically highlight some discriminative frames in an end-to-end framework. The network takes a video with a variable number of face images as its input and produces a fixed-dimension representation. The whole network is composed of two modules. The feature embedding module is a deep Convolutional Neural Network (CNN) which embeds face images into feature vectors. The frame attention module learns multiple attention weights which are used to adaptively aggregate the feature vectors to form a single discriminative video representation. We conduct extensive experiments on CK+ and AFEW8.0 datasets. Our proposed FAN shows superior performance compared to other CNN based methods and achieves state-of-the-art performance on CK+.

READ FULL TEXT

page 2

page 4

research
03/17/2016

Neural Aggregation Network for Video Face Recognition

This paper presents a Neural Aggregation Network (NAN) for video face re...
research
11/23/2017

Attended End-to-end Architecture for Age Estimation from Facial Expression Videos

The main challenges of age estimation from facial expression videos lie ...
research
07/22/2021

Deep 3D-CNN for Depression Diagnosis with Facial Video Recording of Self-Rating Depression Scale Questionnaire

The Self-Rating Depression Scale (SDS) questionnaire is commonly utilize...
research
03/22/2016

Input Aggregated Network for Face Video Representation

Recently, deep neural network has shown promising performance in face im...
research
09/03/2018

A Global Alignment Kernel based Approach for Group-level Happiness Intensity Estimation

With the progress in automatic human behavior understanding, analysing t...
research
05/06/2019

Fine-grained Attention-based Video Face Recognition

This paper aims to learn a compact representation of a video for video f...
research
01/06/2017

Distinguishing Posed and Spontaneous Smiles by Facial Dynamics

Smile is one of the key elements in identifying emotions and present sta...

Please sign up or login with your details

Forgot password? Click here to reset