Facial Action Unit Detection using 3D Facial Landmarks

05/17/2020
by   Saurabh Hinduja, et al.
2

In this paper, we propose to detect facial action units (AU) using 3D facial landmarks. Specifically, we train a 2D convolutional neural network (CNN) on 3D facial landmarks, tracked using a shape index-based statistical shape model, for binary and multi-class AU detection. We show that the proposed approach is able to accurately model AU occurrences, as the movement of the facial landmarks corresponds directly to the movement of the AUs. By training a CNN on 3D landmarks, we can achieve accurate AU detection on two state-of-the-art emotion datasets, namely BP4D and BP4D+. Using the proposed method, we detect multiple AUs on over 330,000 frames, reporting improved results over state-of-the-art methods.

READ FULL TEXT
research
08/15/2022

Deepfake Detection using ImageNet models and Temporal Images of 468 Facial Landmarks

This paper presents our results and findings on the use of temporal imag...
research
07/14/2018

Real-Time Shape Tracking of Facial Landmarks

Detection of facial landmarks and accurate tracking of their shape are e...
research
05/08/2020

A Detailed Look At CNN-based Approaches In Facial Landmark Detection

Facial landmark detection has been studied over decades. Numerous neural...
research
06/05/2019

Infant Contact-less Non-Nutritive Sucking Pattern Quantification via Facial Gesture Analysis

Non-nutritive sucking (NNS) is defined as the sucking action that occurs...
research
12/12/2018

Features Extraction Based on an Origami Representation of 3D Landmarks

Feature extraction analysis has been widely investigated during the last...
research
02/09/2017

EAC-Net: A Region-based Deep Enhancing and Cropping Approach for Facial Action Unit Detection

In this paper, we propose a deep learning based approach for facial acti...
research
05/07/2023

CatFLW: Cat Facial Landmarks in the Wild Dataset

Animal affective computing is a quickly growing field of research, where...

Please sign up or login with your details

Forgot password? Click here to reset