Fitting 3D Morphable Models using Local Features

03/08/2015
by   Patrik Huber, et al.
0

In this paper, we propose a novel fitting method that uses local image features to fit a 3D Morphable Model to 2D images. To overcome the obstacle of optimising a cost function that contains a non-differentiable feature extraction operator, we use a learning-based cascaded regression method that learns the gradient direction from data. The method allows to simultaneously solve for shape and pose parameters. Our method is thoroughly evaluated on Morphable Model generated data and first results on real data are presented. Compared to traditional fitting methods, which use simple raw features like pixel colour or edge maps, local features have been shown to be much more robust against variations in imaging conditions. Our approach is unique in that we are the first to use local features to fit a Morphable Model. Because of the speed of our method, it is applicable for realtime applications. Our cascaded regression framework is available as an open source library (https://github.com/patrikhuber).

READ FULL TEXT
research
12/10/2017

3D Facial Expression Reconstruction using Cascaded Regression

This paper proposes a novel model fitting algorithm for 3D facial expres...
research
08/22/2023

Adaptive Graduated Non-Convexity for Pose Graph Optimization

We present a novel approach to robust pose graph optimization based on G...
research
01/03/2021

Binary Outcome Copula Regression Model with Sampling Gradient Fitting

Use copula to model dependency of variable extends multivariate gaussian...
research
07/11/2022

SDFEst: Categorical Pose and Shape Estimation of Objects from RGB-D using Signed Distance Fields

Rich geometric understanding of the world is an important component of m...
research
03/27/2023

Quantum Multi-Model Fitting

Geometric model fitting is a challenging but fundamental computer vision...
research
12/07/2017

Hybrid eye center localization using cascaded regression and hand-crafted model fitting

We propose a new cascaded regressor for eye center detection. Previous m...
research
05/05/2021

Training Structured Mechanical Models by Minimizing Discrete Euler-Lagrange Residual

Model-based paradigms for decision-making and control are becoming ubiqu...

Please sign up or login with your details

Forgot password? Click here to reset