Local Shape Spectrum Analysis for 3D Facial Expression Recognition

05/19/2017
by   Dmytro Derkach, et al.
0

We investigate the problem of facial expression recognition using 3D data. Building from one of the most successful frameworks for facial analysis using exclusively 3D geometry, we extend the analysis from a curve-based representation into a spectral representation, which allows a complete description of the underlying surface that can be further tuned to the desired level of detail. Spectral representations are based on the decomposition of the geometry in its spatial frequency components, much like a Fourier transform, which are related to intrinsic characteristics of the surface. In this work, we propose the use of Graph Laplacian Features (GLF), which results from the projection of local surface patches into a common basis obtained from the Graph Laplacian eigenspace. We test the proposed approach in the BU-3DFE database in terms of expressions and Action Units recognition. Our results confirm that the proposed GLF produces consistently higher recognition rates than the curves-based approach, thanks to a more complete description of the surface, while requiring a lower computational complexity. We also show that the GLF outperform the most popular alternative approach for spectral representation, Shape- DNA, which is based on the Laplace Beltrami Operator and cannot provide a stable basis that guarantee that the extracted signatures for the different patches are directly comparable.

READ FULL TEXT

page 3

page 4

research
12/28/2020

Human Expression Recognition using Facial Shape Based Fourier Descriptors Fusion

Dynamic facial expression recognition has many useful applications in so...
research
09/30/2018

Spontaneous Facial Expression Recognition using Sparse Representation

Facial expression is the most natural means for human beings to communic...
research
07/21/2017

Steklov Spectral Geometry for Extrinsic Shape Analysis

We propose using the Dirichlet-to-Neumann operator as an extrinsic alter...
research
06/15/2021

Efficient Facial Expression Analysis For Dimensional Affect Recognition Using Geometric Features

Despite their continued popularity, categorical approaches to affect rec...
research
10/23/2019

Facial Expression Restoration Based on Improved Graph Convolutional Networks

Facial expression analysis in the wild is challenging when the facial im...
research
04/02/2010

Facial Expression Representation and Recognition Using 2DHLDA, Gabor Wavelets, and Ensemble Learning

In this paper, a novel method for representation and recognition of the ...
research
04/08/2019

Learned 3D Shape Representations Using Fused Geometrically Augmented Images: Application to Facial Expression and Action Unit Detection

This paper proposes an approach to learn generic multi-modal mesh surfac...

Please sign up or login with your details

Forgot password? Click here to reset