DeepAI AI Chat
Log In Sign Up

Robust Facial Landmark Detection under Significant Head Poses and Occlusion

by   Yue Wu, et al.

There have been tremendous improvements for facial landmark detection on general "in-the-wild" images. However, it is still challenging to detect the facial landmarks on images with severe occlusion and images with large head poses (e.g. profile face). In fact, the existing algorithms usually can only handle one of them. In this work, we propose a unified robust cascade regression framework that can handle both images with severe occlusion and images with large head poses. Specifically, the method iteratively predicts the landmark occlusions and the landmark locations. For occlusion estimation, instead of directly predicting the binary occlusion vectors, we introduce a supervised regression method that gradually updates the landmark visibility probabilities in each iteration to achieve robustness. In addition, we explicitly add occlusion pattern as a constraint to improve the performance of occlusion prediction. For landmark detection, we combine the landmark visibility probabilities, the local appearances, and the local shapes to iteratively update their positions. The experimental results show that the proposed method is significantly better than state-of-the-art works on images with severe occlusion and images with large head poses. It is also comparable to other methods on general "in-the-wild" images.


page 1

page 2

page 3

page 7

page 8


Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

Facial landmark detection, head pose estimation, and facial deformation ...

Mask-FPAN: Semi-Supervised Face Parsing in the Wild With De-Occlusion and UV GAN

Fine-grained semantic segmentation of a person's face and head, includin...

Facial Landmark Detection: a Literature Survey

The locations of the fiducial facial landmark points around facial compo...

An Occluded Stacked Hourglass Approach to Facial Landmark Localization and Occlusion Estimation

A key step to driver safety is to observe the driver's activities with t...

Efficient Branching Cascaded Regression for Face Alignment under Significant Head Rotation

Despite much interest in face alignment in recent years, the large major...

Pixel-In-Pixel Net: Towards Efficient Facial Landmark Detection in the Wild

Recently, heatmap regression based models become popular because of thei...