Unsupervised Performance Analysis of 3D Face Alignment

04/14/2020
by   Mostafa Sadeghi, et al.
0

We address the problem of analyzing the performance of 3D face alignment (3DFA) algorithms. Traditionally, performance analysis relies on carefully annotated datasets. Here, these annotations correspond to the 3D coordinates of a set of pre-defined facial landmarks. However, this annotation process, be it manual or automatic, is rarely error-free, which strongly biases the analysis. In contrast, we propose a fully unsupervised methodology based on robust statistics and a parametric confidence test. We revisit the problem of robust estimation of the rigid transformation between two point sets and we describe two algorithms, one based on a mixture between a Gaussian and a uniform distribution, and another one based on the generalized Student's t-distribution. We show that these methods are robust to up to 50% outliers, which makes them suitable for mapping a face, from an unknown pose to a frontal pose, in the presence of facial expressions and occlusions. Using these methods in conjunction with large datasets of face images, we build a statistical frontal facial model and an associated parametric confidence metric, eventually used for performance analysis. We empirically show that the proposed pipeline is neither method-biased nor data-biased, and that it can be used to assess both the performance of 3DFA algorithms and the accuracy of annotations of face datasets.

READ FULL TEXT

page 16

page 17

research
12/02/2020

ACE-Net: Fine-Level Face Alignment through Anchors and Contours Estimation

We propose a novel facial Anchors and Contours Estimation framework, ACE...
research
07/19/2017

Face Alignment Robust to Pose, Expressions and Occlusions

We propose an Ensemble of Robust Constrained Local Models for alignment ...
research
08/25/2023

3D Face Alignment Through Fusion of Head Pose Information and Features

The ability of humans to infer head poses from face shapes, and vice ver...
research
08/16/2014

Robust 3D face recognition in presence of pose and partial occlusions or missing parts

In this paper, we propose a robust 3D face recognition system which can ...
research
11/13/2015

Robust Face Alignment Using a Mixture of Invariant Experts

Face alignment, which is the task of finding the locations of a set of f...
research
03/17/2018

Convolutional Point-set Representation: A Convolutional Bridge Between a Densely Annotated Image and 3D Face Alignment

We present a robust method for estimating the facial pose and shape info...
research
08/15/2016

Face Alignment In-the-Wild: A Survey

Over the last two decades, face alignment or localizing fiducial facial ...

Please sign up or login with your details

Forgot password? Click here to reset