Efficient Branching Cascaded Regression for Face Alignment under Significant Head Rotation

11/05/2016
by   Brandon M. Smith, et al.
0

Despite much interest in face alignment in recent years, the large majority of work has focused on near-frontal faces. Algorithms typically break down on profile faces, or are too slow for real-time applications. In this work we propose an efficient approach to face alignment that can handle 180 degrees of head rotation in a unified way (e.g., without resorting to view-based models) using 2D training data. The foundation of our approach is cascaded shape regression (CSR), which has emerged recently as the leading strategy. We propose a generalization of conventional CSRs that we call branching cascaded regression (BCR). Conventional CSRs are single-track; that is, they progress from one cascade level to the next in a straight line, with each regressor attempting to fit the entire dataset. We instead split the regression problem into two or more simpler ones after each cascade level. Intuitively, each regressor can then operate on a simpler objective function (i.e., with fewer conflicting gradient directions). Within the BCR framework, we model and infer pose-related landmark visibility and face shape simultaneously using Structured Point Distribution Models (SPDMs). We propose to learn task-specific feature mapping functions that are adaptive to landmark visibility, and that use SPDM parameters as regression targets instead of 2D landmark coordinates. Additionally, we introduce a new in-the-wild dataset of profile faces to validate our approach.

READ FULL TEXT

page 1

page 6

page 8

research
04/14/2020

Deep Entwined Learning Head Pose and Face Alignment Inside an Attentional Cascade with Doubly-Conditional fusion

Head pose estimation and face alignment constitute a backbone preprocess...
research
11/23/2017

Self-Reinforced Cascaded Regression for Face Alignment

Cascaded regression is prevailing in face alignment thanks to its accura...
research
09/23/2017

Robust Facial Landmark Detection under Significant Head Poses and Occlusion

There have been tremendous improvements for facial landmark detection on...
research
06/06/2017

Face Alignment Using K-Cluster Regression Forests With Weighted Splitting

In this work we present a face alignment pipeline based on two novel met...
research
04/02/2018

Face Alignment in Full Pose Range: A 3D Total Solution

Face alignment, which fits a face model to an image and extracts the sem...
research
05/10/2019

A fast online cascaded regression algorithm for face alignment

Traditional face alignment based on machine learning usually tracks the ...
research
11/30/2016

Efficient Likelihood Bayesian Constrained Local Model

The constrained local model (CLM) proposes a paradigm that the locations...

Please sign up or login with your details

Forgot password? Click here to reset