Automatic Analysis of Facial Expressions Based on Deep Covariance Trajectories

10/25/2018
by   Naima Otberdout, et al.
8

In this paper, we propose a new approach for facial expression recognition. The solution is based on the idea of encoding local and global Deep Convolutional Neural Network (DCNN) features extracted from still images, in compact local and global covariance descriptors. The space geometry of the covariance matrices is that of Symmetric Positive Definite (SPD) matrices. By performing the classification of static facial expressions using a valid Gaussian kernel on the SPD manifold and Support Vector Machine (SVM), we show that the covariance descriptors computed on DCNN features are more effective than the standard classification with fully connected layers and softmax. Besides, we propose a completely new and original solution to model the temporal dynamic of facial expressions as deep trajectories on the SPD manifold. As an extension of the classification pipeline of covariance descriptors, we apply SVM with valid positive definite kernels derived from global alignment for deep covariance trajectories classification. By conducting extensive experiments on the Oulu-CASIA, CK+, and SFEW datasets, we show that both the proposed static and dynamic approaches achieve state-of-the-art performance for facial expression recognition outperforming most recent approaches.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 12

page 13

page 14

research
05/10/2018

Deep Covariance Descriptors for Facial Expression Recognition

In this paper, covariance matrices are exploited to encode the deep conv...
research
05/12/2021

Deep and Shallow Covariance Feature Quantization for 3D Facial Expression Recognition

Facial expressions recognition (FER) of 3D face scans has received a sig...
research
05/13/2018

Covariance Pooling For Facial Expression Recognition

Classifying facial expressions into different categories requires captur...
research
07/20/2017

A Novel Space-Time Representation on the Positive Semidefinite Con for Facial Expression Recognition

In this paper, we study the problem of facial expression recognition usi...
research
03/23/2015

Video-Based Action Recognition Using Rate-Invariant Analysis of Covariance Trajectories

Statistical classification of actions in videos is mostly performed by e...
research
06/08/2013

Emotional Expression Classification using Time-Series Kernels

Estimation of facial expressions, as spatio-temporal processes, can take...
research
09/05/2022

Automatic Estimation of Self-Reported Pain by Trajectory Analysis in the Manifold of Fixed Rank Positive Semi-Definite Matrices

We propose an automatic method to estimate self-reported pain based on f...

Please sign up or login with your details

Forgot password? Click here to reset