Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction

06/14/2021
by   Xiangnan Yin, et al.
0

Although much progress has been made recently in 3D face reconstruction, most previous work has been devoted to predicting accurate and fine-grained 3D shapes. In contrast, relatively little work has focused on generating high-fidelity face textures. Compared with the prosperity of photo-realistic 2D face image generation, high-fidelity 3D face texture generation has yet to be studied. In this paper, we proposed a novel UV map generation model that predicts the UV map from a single face image. The model consists of a UV sampler and a UV generator. By selectively sampling the input face image's pixels and adjusting their relative locations, the UV sampler generates an incomplete UV map that could faithfully reconstruct the original face. Missing textures in the incomplete UV map are further full-filled by the UV generator. The training is based on pseudo ground truth blended by the 3DMM texture and the input face texture, thus weakly supervised. To deal with the artifacts in the imperfect pseudo UV map, multiple partial UV map discriminators are leveraged.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

research
03/12/2020

Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks

3D Morphable Model (3DMM) based methods have achieved great success in r...
research
09/19/2022

BareSkinNet: De-makeup and De-lighting via 3D Face Reconstruction

We propose BareSkinNet, a novel method that simultaneously removes makeu...
research
10/10/2021

Unsupervised High-Fidelity Facial Texture Generation and Reconstruction

Many methods have been proposed over the years to tackle the task of fac...
research
07/25/2019

Self-Supervised Adaptation of High-Fidelity Face Models for Monocular Performance Tracking

Improvements in data-capture and face modeling techniques have enabled u...
research
12/14/2021

Weakly Supervised High-Fidelity Clothing Model Generation

The development of online economics arouses the demand of generating ima...
research
05/15/2021

Texture Generation with Neural Cellular Automata

Neural Cellular Automata (NCA) have shown a remarkable ability to learn ...
research
08/22/2023

Weakly Supervised Face and Whole Body Recognition in Turbulent Environments

Face and person recognition have recently achieved remarkable success un...

Please sign up or login with your details

Forgot password? Click here to reset