3D Face Hallucination from a Single Depth Frame

09/13/2018
by   Shu Liang, et al.
0

We present an algorithm that takes a single frame of a person's face from a depth camera, e.g., Kinect, and produces a high-resolution 3D mesh of the input face. We leverage a dataset of 3D face meshes of 1204 distinct individuals ranging from age 3 to 40, captured in a neutral expression. We divide the input depth frame into semantically significant regions (eyes, nose, mouth, cheeks) and search the database for the best matching shape per region. We further combine the input depth frame with the matched database shapes into a single mesh that results in a high-resolution shape of the input person. Our system is fully automatic and uses only depth data for matching, making it invariant to imaging conditions. We evaluate our results using ground truth shapes, as well as compare to state-of-the-art shape estimation methods. We demonstrate the robustness of our local matching approach with high-quality reconstruction of faces that fall outside of the dataset span, e.g., faces older than 40 years old, facial expressions, and different ethnicities.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
05/16/2019

Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervision

The estimation of 3D face shape from a single image must be robust to va...
research
03/30/2020

AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"

Over the last years, with the advent of Generative Adversarial Networks ...
research
03/18/2022

REALY: Rethinking the Evaluation of 3D Face Reconstruction

The evaluation of 3D face reconstruction results typically relies on a r...
research
11/20/2021

Identity-Preserving Pose-Robust Face Hallucination Through Face Subspace Prior

Over the past few decades, numerous attempts have been made to address t...
research
09/19/2020

High-Resolution Augmentation for Automatic Template-Based Matching of Human Models

We propose a new approach for 3D shape matching of deformable human shap...
research
02/24/2019

3D Guided Fine-Grained Face Manipulation

We present a method for fine-grained face manipulation. Given a face ima...
research
01/16/2019

Lightweight Markerless Monocular Face Capture with 3D Spatial Priors

We present a simple lightweight markerless facial performance capture fr...

Please sign up or login with your details

Forgot password? Click here to reset