FacePoseNet: Making a Case for Landmark-Free Face Alignment

08/24/2017
by   Fengju Chang, et al.
0

We show how a simple convolutional neural network (CNN) can be trained to accurately and robustly regress 6 degrees of freedom (6DoF) 3D head pose, directly from image intensities. We further explain how this FacePoseNet (FPN) can be used to align faces in 2D and 3D as an alternative to explicit facial landmark detection for these tasks. We claim that in many cases the standard means of measuring landmark detector accuracy can be misleading when comparing different face alignments. Instead, we compare our FPN with existing methods by evaluating how they affect face recognition accuracy on the IJB-A and IJB-B benchmarks: using the same recognition pipeline, but varying the face alignment method. Our results show that (a) better landmark detection accuracy measured on the 300W benchmark does not necessarily imply better face recognition accuracy. (b) Our FPN provides superior 2D and 3D face alignment on both benchmarks. Finally, (c), FPN aligns faces at a small fraction of the computational cost of comparably accurate landmark detectors. For many purposes, FPN is thus a far faster and far more accurate face alignment method than using facial landmark detectors.

READ FULL TEXT

page 1

page 4

page 5

page 8

research
11/12/2015

Facial Landmark Detection with Tweaked Convolutional Neural Networks

We present a novel convolutional neural network (CNN) design for facial ...
research
08/23/2016

Failure Detection for Facial Landmark Detectors

Most face applications depend heavily on the accuracy of the face and fa...
research
12/14/2020

img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimation

We propose real-time, six degrees of freedom (6DoF), 3D face pose estima...
research
12/09/2021

Modelling Lips-State Detection Using CNN for Non-Verbal Communications

Vision-based deep learning models can be promising for speech-and-hearin...
research
09/01/2022

On the detection of morphing attacks generated by GANs

Recent works have demonstrated the feasibility of GAN-based morphing att...
research
02/01/2021

Landmark Breaker: Obstructing DeepFake By Disturbing Landmark Extraction

The recent development of Deep Neural Networks (DNN) has significantly i...
research
03/18/2016

A Comprehensive Performance Evaluation of Deformable Face Tracking "In-the-Wild"

Recently, technologies such as face detection, facial landmark localisat...

Please sign up or login with your details

Forgot password? Click here to reset