Towards High-fidelity Nonlinear 3D Face Morphable Model

04/09/2019
by   Luan Tran, et al.
30

Embedding 3D morphable basis functions into deep neural networks opens great potential for models with better representation power. However, to faithfully learn those models from an image collection, it requires strong regularization to overcome ambiguities involved in the learning process. This critically prevents us from learning high fidelity face models which are needed to represent face images in high level of details. To address this problem, this paper presents a novel approach to learn additional proxies as means to side-step strong regularizations, as well as, leverages to promote detailed shape/albedo. To ease the learning, we also propose to use a dual-pathway network, a carefully-designed architecture that brings a balance between global and local-based models. By improving the nonlinear 3D morphable model in both learning objective and network architecture, we present a model which is superior in capturing higher level of details than the linear or its precedent nonlinear counterparts. As a result, our model achieves state-of-the-art performance on 3D face reconstruction by solely optimizing latent representations.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

research
05/09/2022

NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representations

Undoubtedly, high-fidelity 3D hair plays an indispensable role in digita...
research
08/28/2018

On Learning 3D Face Morphable Model from In-the-wild Images

As a classic statistical model of 3D facial shape and albedo, 3D Morphab...
research
04/11/2018

Nonlinear 3D Face Morphable Model

As a classic statistical model of 3D facial shape and texture, 3D Morpha...
research
06/15/2021

Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collection

Non-parametric face modeling aims to reconstruct 3D face only from image...
research
06/17/2023

MA-NeRF: Motion-Assisted Neural Radiance Fields for Face Synthesis from Sparse Images

We address the problem of photorealistic 3D face avatar synthesis from s...
research
07/25/2019

Self-Supervised Adaptation of High-Fidelity Face Models for Monocular Performance Tracking

Improvements in data-capture and face modeling techniques have enabled u...
research
12/15/2021

Detail-aware Deep Clothing Animations Infused with Multi-source Attributes

This paper presents a novel learning-based clothing deformation method t...

Please sign up or login with your details

Forgot password? Click here to reset