Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks

05/22/2017
by   Behzad Hasani, et al.
0

Deep Neural Networks (DNNs) have shown to outperform traditional methods in various visual recognition tasks including Facial Expression Recognition (FER). In spite of efforts made to improve the accuracy of FER systems using DNN, existing methods still are not generalizable enough in practical applications. This paper proposes a 3D Convolutional Neural Network method for FER in videos. This new network architecture consists of 3D Inception-ResNet layers followed by an LSTM unit that together extracts the spatial relations within facial images as well as the temporal relations between different frames in the video. Facial landmark points are also used as inputs to our network which emphasize on the importance of facial components rather than the facial regions that may not contribute significantly to generating facial expressions. Our proposed method is evaluated using four publicly available databases in subject-independent and cross-database tasks and outperforms state-of-the-art methods.

READ FULL TEXT

page 4

page 7

research
03/20/2017

Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields

Automated Facial Expression Recognition (FER) has been a challenging tas...
research
11/12/2015

Going Deeper in Facial Expression Recognition using Deep Neural Networks

Automated Facial Expression Recognition (FER) has remained a challenging...
research
03/05/2019

Bounded Residual Gradient Networks (BReG-Net) for Facial Affect Computing

Residual-based neural networks have shown remarkable results in various ...
research
12/05/2019

E2-Capsule Neural Networks for Facial Expression Recognition Using AU-Aware Attention

Capsule neural network is a new and popular technique in deep learning. ...
research
03/05/2015

Deep Temporal Appearance-Geometry Network for Facial Expression Recognition

Temporal information can provide useful features for recognizing facial ...
research
11/29/2017

Interpretable Facial Relational Network Using Relational Importance

Human face analysis is an important task in computer vision. According t...
research
12/07/2018

Backdooring Convolutional Neural Networks via Targeted Weight Perturbations

We present a new type of backdoor attack that exploits a vulnerability o...

Please sign up or login with your details

Forgot password? Click here to reset