Landmark Weighting for 3DMM Shape Fitting

08/16/2018
by   Yu Yanga, et al.
0

Human face is a 3D object with shape and surface texture. 3D Morphable Model (3DMM) is a powerful tool for reconstructing the 3D face from a single 2D face image. In the shape fitting process, 3DMM estimates the correspondence between 2D and 3D landmarks. Most traditional 3DMM fitting methods fail to reconstruct an accurate model because face shape fitting is a difficult non-linear optimization problem. In this paper we show that landmark weighting is instrumental to improve the accuracy of shape reconstruction and propose a novel 3D Morphable Model Fitting method. Different from previous works that treat all landmarks equally, we take into consideration the estimated errors for each pair of 2D and 3D corresponding landmarks. The landmark points are weighted in the optimization cost function based on these errors. Obviously, these landmarks have different semantics because they locate on different facial components. In the context of the solution of fitting is approximated, there are deviations in landmarks matching. However, these landmarks with different semantics have different effects on reconstructing 3D faces. Thus, it is necessary to consider each landmark individually. To our knowledge, we are the first to analyze each feature point for 3D face reconstruction by 3DMM. The weight is adaptive with the estimation residuals of landmarks. Experimental results show that the proposed method significantly reduces the reconstruction error and improves the authenticity of the 3D model expression.

READ FULL TEXT

page 2

page 3

page 6

research
04/06/2022

3D face reconstruction with dense landmarks

Landmarks often play a key role in face analysis, but many aspects of id...
research
09/28/2016

A Simple, Fast and Highly-Accurate Algorithm to Recover 3D Shape from 2D Landmarks on a Single Image

Three-dimensional shape reconstruction of 2D landmark points on a single...
research
10/13/2017

Automatic Detection and Uncertainty Quantification of Landmarks on Elastic Curves

A population quantity of interest in statistical shape analysis is the l...
research
05/17/2023

Automatic 3D Registration of Dental CBCT and Face Scan Data using 2D Projection images

This paper presents a fully automatic registration method of dental cone...
research
07/28/2017

A weighting strategy for Active Shape Models

Active Shape Models (ASM) are an iterative segmentation technique to fin...
research
08/22/2017

What does 2D geometric information really tell us about 3D face shape?

A face image contains geometric cues in the form of configurational info...
research
11/29/2021

Learning to Fit Morphable Models

Fitting parametric models of human bodies, hands or faces to sparse inpu...

Please sign up or login with your details

Forgot password? Click here to reset