Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

09/23/2017
by   Yue Wu, et al.
0

Facial landmark detection, head pose estimation, and facial deformation analysis are typical facial behavior analysis tasks in computer vision. The existing methods usually perform each task independently and sequentially, ignoring their interactions. To tackle this problem, we propose a unified framework for simultaneous facial landmark detection, head pose estimation, and facial deformation analysis, and the proposed model is robust to facial occlusion. Following a cascade procedure augmented with model-based head pose estimation, we iteratively update the facial landmark locations, facial occlusion, head pose and facial de- formation until convergence. The experimental results on benchmark databases demonstrate the effectiveness of the proposed method for simultaneous facial landmark detection, head pose and facial deformation estimation, even if the images are under facial occlusion.

READ FULL TEXT
research
09/23/2017

Robust Facial Landmark Detection under Significant Head Poses and Occlusion

There have been tremendous improvements for facial landmark detection on...
research
09/23/2017

Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection

Cascade regression framework has been shown to be effective for facial l...
research
02/05/2018

An Occluded Stacked Hourglass Approach to Facial Landmark Localization and Occlusion Estimation

A key step to driver safety is to observe the driver's activities with t...
research
10/30/2019

Facial Image Deformation Based on Landmark Detection

In this work, we use facial landmarks to make the deformation for facial...
research
05/17/2023

LPMM: Intuitive Pose Control for Neural Talking-Head Model via Landmark-Parameter Morphable Model

While current talking head models are capable of generating photorealist...
research
10/09/2015

Human Head Pose Estimation by Facial Features Location

We describe a method for estimating human head pose in a color image tha...
research
11/18/2019

Multiple Face Analyses through Adversarial Learning

This inherent relations among multiple face analysis tasks, such as land...

Please sign up or login with your details

Forgot password? Click here to reset