Domain Engineering for Applied Monocular Reconstruction of Parametric Faces

09/06/2022
by   Igor Borovikov, et al.
4

Many modern online 3D applications and video games rely on parametric models of human faces for creating believable avatars. However, manually reproducing someone's facial likeness with a parametric model is difficult and time-consuming. Machine Learning solution for that task is highly desirable but is also challenging. The paper proposes a novel approach to the so-called Face-to-Parameters problem (F2P for short), aiming to reconstruct a parametric face from a single image. The proposed method utilizes synthetic data, domain decomposition, and domain adaptation to address multifaceted challenges in solving the F2P. The open-sourced codebase illustrates our key observations and provides means for quantitative evaluation. The presented approach proves practical in an industrial application; it improves accuracy and allows for more efficient models training. The techniques have the potential to extend to other types of parametric models.

READ FULL TEXT

page 8

page 9

page 11

page 12

page 15

page 19

research
08/05/2022

Applied monocular reconstruction of parametric faces with domain engineering

Many modern online 3D applications and videogames rely on parametric mod...
research
09/30/2021

Fake It Till You Make It: Face analysis in the wild using synthetic data alone

We demonstrate that it is possible to perform face-related computer visi...
research
09/14/2016

3D Face Reconstruction by Learning from Synthetic Data

Fast and robust three-dimensional reconstruction of facial geometric str...
research
10/09/2020

Learning 3D Face Reconstruction with a Pose Guidance Network

We present a self-supervised learning approach to learning monocular 3D ...
research
10/14/2021

Relighting Humans in the Wild: Monocular Full-Body Human Relighting with Domain Adaptation

The modern supervised approaches for human image relighting rely on trai...
research
08/19/2020

Cross-Domain Identification for Thermal-to-Visible Face Recognition

Recent advances in domain adaptation, especially those applied to hetero...
research
03/09/2021

PGD-based advanced nonlinear multiparametric regressions for constructing metamodels at the scarce-data limit

Regressions created from experimental or simulated data enable the const...

Please sign up or login with your details

Forgot password? Click here to reset