Subject Identification Across Large Expression Variations Using 3D Facial Landmarks

05/17/2020
by   Sk Rahatul Jannat, et al.
13

Landmark localization is an important first step towards geometric based vision research including subject identification. Considering this, we propose to use 3D facial landmarks for the task of subject identification, over a range of expressed emotion. Landmarks are detected, using a Temporal Deformable Shape Model and used to train a Support Vector Machine (SVM), Random Forest (RF), and Long Short-term Memory (LSTM) neural network for subject identification. As we are interested in subject identification with large variations in expression, we conducted experiments on 3 emotion-based databases, namely the BU-4DFE, BP4D, and BP4D+ 3D/4D face databases. We show that our proposed method outperforms current state of the art methods for subject identification on BU-4DFE and BP4D. To the best of our knowledge, this is the first work to investigate subject identification on the BP4D+, resulting in a baseline for the community.

READ FULL TEXT
research
10/11/2019

Landmarks-assisted Collaborative Deep Framework for Automatic 4D Facial Expression Recognition

We propose a novel landmarks-assisted collaborative end-to-end deep fram...
research
02/08/2020

Sparsity-Aware Deep Learning for Automatic 4D Facial Expression Recognition

In this paper, we present a sparsity-aware deep network for automatic 4D...
research
12/10/2017

3D Facial Expression Reconstruction using Cascaded Regression

This paper proposes a novel model fitting algorithm for 3D facial expres...
research
04/16/2020

Unsupervised Learning of Landmarks based on Inter-Intra Subject Consistencies

We present a novel unsupervised learning approach to image landmark disc...
research
07/21/2021

Structure-Aware Long Short-Term Memory Network for 3D Cephalometric Landmark Detection

Detecting 3D landmarks on cone-beam computed tomography (CBCT) is crucia...
research
10/06/2018

Deep Geodesic Learning for Segmentation and Anatomical Landmarking

In this paper, we propose a novel deep learning framework for anatomy se...
research
09/11/2019

Multi-Year Vector Dynamic Time Warping Based Crop Mapping

Recent automated crop mapping via supervised learning-based methods have...

Please sign up or login with your details

Forgot password? Click here to reset