Landmarks-assisted Collaborative Deep Framework for Automatic 4D Facial Expression Recognition

10/11/2019
by   Muzammil Behzad, et al.
0

We propose a novel landmarks-assisted collaborative end-to-end deep framework for automatic 4D FER. Using 4D face scan data, we calculate its various geometrical images, and afterwards use rank pooling to generate their dynamic images encapsulating important facial muscle movements over time. As well, the given 3D landmarks are projected on a 2D plane as binary images and convolutional layers are used to extract sequences of feature vectors for every landmark video. During the training stage, the dynamic images are used to train an end-to-end deep network, while the feature vectors of landmark images are used train a long short-term memory (LSTM) network. The finally improved set of expression predictions are obtained when the dynamic and landmark images collaborate over multi-views using the proposed deep framework. Performance results obtained from extensive experimentation on the widely-adopted BU-4DFE database under globally used settings prove that our proposed collaborative framework outperforms the state-of-the-art 4D FER methods and reach a promising classification accuracy of 96.7

READ FULL TEXT
research
02/08/2020

Sparsity-Aware Deep Learning for Automatic 4D Facial Expression Recognition

In this paper, we present a sparsity-aware deep network for automatic 4D...
research
05/07/2019

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network

This paper proposes a novel 4D Facial Expression Recognition (FER) metho...
research
05/17/2020

Subject Identification Across Large Expression Variations Using 3D Facial Landmarks

Landmark localization is an important first step towards geometric based...
research
10/09/2022

Less is More: Facial Landmarks can Recognize a Spontaneous Smile

Smile veracity classification is a task of interpreting social interacti...
research
04/16/2019

LBVCNN: Local Binary Volume Convolutional Neural Network for Facial Expression Recognition from Image Sequences

Recognizing facial expressions is one of the central problems in compute...
research
07/21/2021

Structure-Aware Long Short-Term Memory Network for 3D Cephalometric Landmark Detection

Detecting 3D landmarks on cone-beam computed tomography (CBCT) is crucia...
research
01/18/2017

Effective Multi-Query Expansions: Collaborative Deep Networks for Robust Landmark Retrieval

Given a query photo issued by a user (q-user), the landmark retrieval is...

Please sign up or login with your details

Forgot password? Click here to reset