Local Learning with Deep and Handcrafted Features for Facial Expression Recognition

We present an approach that combines automatic features learned by convolutional neural networks (CNN) and handcrafted features computed by the bag-of-visual-words (BOVW) model in order to achieve state-of-the-art results in facial expression recognition. In order to obtain automatic features, we experiment with multiple CNN architectures, pre-trained models and training procedures, e.g. Dense-Sparse-Dense. After fusing the two types of features, we employ a local learning framework to predict the class label for each test image. The local learning framework is based on three steps. First, a k-nearest neighbors model is applied for selecting the nearest training samples for an input test image. Second, a one-versus-all Support Vector Machines (SVM) classifier is trained on the selected training samples. Finally, the SVM classifier is used for predicting the class label only for the test image it was trained for. Although local learning has been used before in combination with handcrafted features, to the best of our knowledge, it has never been employed in combination with deep features. The experiments on the 2013 Facial Expression Recognition (FER) Challenge data set and the FER+ data set demonstrate that our approach achieves state-of-the-art results. With a top accuracy of 75.42 surpass all competition by nearly 2

READ FULL TEXT
research
08/09/2016

Facial Expression Recognition Using a Hybrid CNN-SIFT Aggregator

Deriving an effective facial expression recognition component is importa...
research
03/30/2018

On the Resistance of Neural Nets to Label Noise

We investigate the behavior of convolutional neural networks (CNN) in th...
research
10/03/2020

Deep Convolutional Neural Network Based Facial Expression Recognition in the Wild

This paper describes the proposed methodology, data used and the results...
research
11/10/2015

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition

In this paper, we present a novel approach to automatic 3D Facial Expres...
research
11/14/2016

Baseline CNN structure analysis for facial expression recognition

We present a baseline convolutional neural network (CNN) structure and i...
research
06/10/2014

Why do linear SVMs trained on HOG features perform so well?

Linear Support Vector Machines trained on HOG features are now a de fact...
research
09/03/2018

A Global Alignment Kernel based Approach for Group-level Happiness Intensity Estimation

With the progress in automatic human behavior understanding, analysing t...

Please sign up or login with your details

Forgot password? Click here to reset