FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction

03/31/2020
by   Haotian Yang, et al.
0

In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and propose a novel algorithm that is able to predict elaborate riggable 3D face models from a single image input. FaceScape dataset provides 18,760 textured 3D faces, captured from 938 subjects and each with 20 specific expressions. The 3D models contain the pore-level facial geometry that is also processed to be topologically uniformed. These fine 3D facial models can be represented as a 3D morphable model for rough shapes and displacement maps for detailed geometry. Taking advantage of the large-scale and high-accuracy dataset, a novel algorithm is further proposed to learn the expression-specific dynamic details using a deep neural network. The learned relationship serves as the foundation of our 3D face prediction system from a single image input. Different than the previous methods, our predicted 3D models are riggable with highly detailed geometry under different expressions. The unprecedented dataset and code will be released to public for research purpose.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
12/14/2020

FaceDet3D: Facial Expressions with 3D Geometric Detail Prediction

Facial Expressions induce a variety of high-level details on the 3D face...
research
11/15/2016

Learning Detailed Face Reconstruction from a Single Image

Reconstructing the detailed geometric structure of a face from a given i...
research
03/27/2020

Lightweight Photometric Stereo for Facial Details Recovery

Recently, 3D face reconstruction from a single image has achieved great ...
research
02/28/2023

A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Images

Limited by the nature of the low-dimensional representational capacity o...
research
10/25/2019

Self-supervised Learning of Detailed 3D Face Reconstruction

In this paper, we present an end-to-end learning framework for detailed ...
research
12/14/2017

Extreme 3D Face Reconstruction: Looking Past Occlusions

Existing single view, 3D face reconstruction methods can produce beautif...
research
04/11/2019

Learning to Take Good Pictures of People with a Robot Photographer

We present a robotic system capable of navigating autonomously by follow...

Please sign up or login with your details

Forgot password? Click here to reset