Face Alignment in Full Pose Range: A 3D Total Solution

by   Xiangyu Zhu, et al.

Face alignment, which fits a face model to an image and extracts the semantic meanings of facial pixels, has been an important topic in the computer vision community. However, most algorithms are designed for faces in small to medium poses (yaw angle is smaller than 45 degrees), which lack the ability to align faces in large poses up to 90 degrees. The challenges are three-fold. Firstly, the commonly used landmark face model assumes that all the landmarks are visible and is therefore not suitable for large poses. Secondly, the face appearance varies more drastically across large poses, from the frontal view to the profile view. Thirdly, labelling landmarks in large poses is extremely challenging since the invisible landmarks have to be guessed. In this paper, we propose to tackle these three challenges in an new alignment framework termed 3D Dense Face Alignment (3DDFA), in which a dense 3D Morphable Model (3DMM) is fitted to the image via Cascaded Convolutional Neural Networks. We also utilize 3D information to synthesize face images in profile views to provide abundant samples for training. Experiments on the challenging AFLW database show that the proposed approach achieves significant improvements over the state-of-the-art methods.


page 1

page 5

page 7

page 8

page 9

page 10

page 12

page 14


Pose-Invariant 3D Face Alignment

Face alignment aims to estimate the locations of a set of landmarks for ...

FreeEnricher: Enriching Face Landmarks without Additional Cost

Recent years have witnessed significant growth of face alignment. Though...

3D Face Alignment Through Fusion of Head Pose Information and Features

The ability of humans to infer head poses from face shapes, and vice ver...

Face Alignment Using Active Shape Model And Support Vector Machine

The Active Shape Model (ASM) is one of the most popular local texture mo...

Simultaneous regression and feature learning for facial landmarking

Face alignment (or facial landmarking) is an important task in many face...

DSFNet: Dual Space Fusion Network for Occlusion-Robust 3D Dense Face Alignment

Sensitivity to severe occlusion and large view angles limits the usage s...

Efficient Branching Cascaded Regression for Face Alignment under Significant Head Rotation

Despite much interest in face alignment in recent years, the large major...

Please sign up or login with your details

Forgot password? Click here to reset