Sparse Photometric 3D Face Reconstruction Guided by Morphable Models

11/29/2017
by   Xuan Cao, et al.
ShanghaiTech University
0

We present a novel 3D face reconstruction technique that leverages sparse photometric stereo (PS) and latest advances on face registration/modeling from a single image. We observe that 3D morphable faces approach provides a reasonable geometry proxy for light position calibration. Specifically, we develop a robust optimization technique that can calibrate per-pixel lighting direction and illumination at a very high precision without assuming uniform surface albedos. Next, we apply semantic segmentation on input images and the geometry proxy to refine hairy vs. bare skin regions using tailored filters. Experiments on synthetic and real data show that by using a very small set of images, our technique is able to reconstruct fine geometric details such as wrinkles, eyebrows, whelks, pores, etc, comparable to and sometimes surpassing movie quality productions.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

04/04/2019

3D Face Reconstruction Using Color Photometric Stereo with Uncalibrated Near Point Lights

We present a new color photometric stereo (CPS) method that can recover ...
03/26/2019

Photo-Realistic Facial Details Synthesis from Single Immage

We present a single-image 3D face synthesis technique that can handle ch...
03/27/2020

Lightweight Photometric Stereo for Facial Details Recovery

Recently, 3D face reconstruction from a single image has achieved great ...
05/18/2011

Face Shape and Reflectance Acquisition using a Multispectral Light Stage

In this thesis, we discuss the design and calibration (geometric and rad...
08/24/2020

Monocular Reconstruction of Neural Face Reflectance Fields

The reflectance field of a face describes the reflectance properties res...
07/21/2020

Recurrent Exposure Generation for Low-Light Face Detection

Face detection from low-light images is challenging due to limited photo...
03/26/2018

Semantic See-Through Rendering on Light Fields

We present a novel semantic light field (LF) refocusing technique that c...

Please sign up or login with your details

Forgot password? Click here to reset