Sparse Photometric 3D Face Reconstruction Guided by Morphable Models

by   Xuan Cao, et al.
ShanghaiTech University

We present a novel 3D face reconstruction technique that leverages sparse photometric stereo (PS) and latest advances on face registration/modeling from a single image. We observe that 3D morphable faces approach provides a reasonable geometry proxy for light position calibration. Specifically, we develop a robust optimization technique that can calibrate per-pixel lighting direction and illumination at a very high precision without assuming uniform surface albedos. Next, we apply semantic segmentation on input images and the geometry proxy to refine hairy vs. bare skin regions using tailored filters. Experiments on synthetic and real data show that by using a very small set of images, our technique is able to reconstruct fine geometric details such as wrinkles, eyebrows, whelks, pores, etc, comparable to and sometimes surpassing movie quality productions.


page 1

page 3

page 6

page 7

page 8


3D Face Reconstruction Using Color Photometric Stereo with Uncalibrated Near Point Lights

We present a new color photometric stereo (CPS) method that can recover ...

Photo-Realistic Facial Details Synthesis from Single Immage

We present a single-image 3D face synthesis technique that can handle ch...

Lightweight Photometric Stereo for Facial Details Recovery

Recently, 3D face reconstruction from a single image has achieved great ...

Face Shape and Reflectance Acquisition using a Multispectral Light Stage

In this thesis, we discuss the design and calibration (geometric and rad...

Monocular Reconstruction of Neural Face Reflectance Fields

The reflectance field of a face describes the reflectance properties res...

Recurrent Exposure Generation for Low-Light Face Detection

Face detection from low-light images is challenging due to limited photo...

Semantic See-Through Rendering on Light Fields

We present a novel semantic light field (LF) refocusing technique that c...

Please sign up or login with your details

Forgot password? Click here to reset