DeepAI AI Chat
Log In Sign Up

Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation

by   Matan Sela, et al.

It has been recently shown that neural networks can recover the geometric structure of a face from a single given image. A common denominator of most existing face geometry reconstruction methods is the restriction of the solution space to some low-dimensional subspace. While such a model significantly simplifies the reconstruction problem, it is inherently limited in its expressiveness. As an alternative, we propose an Image-to-Image translation network that jointly maps the input image to a depth image and a facial correspondence map. This explicit pixel-based mapping can then be utilized to provide high quality reconstructions of diverse faces under extreme expressions, using a purely geometric refinement process. In the spirit of recent approaches, the network is trained only with synthetic data, and is then evaluated on in-the-wild facial images. Both qualitative and quantitative analyses demonstrate the accuracy and the robustness of our approach.


page 3

page 6

page 7

page 8

page 14

page 15

page 16

page 17


3D Face Reconstruction by Learning from Synthetic Data

Fast and robust three-dimensional reconstruction of facial geometric str...

InverseFaceNet: Deep Single-Shot Inverse Face Rendering From A Single Image

We introduce InverseFaceNet, a deep convolutional inverse rendering fram...

Unsupervised Depth Estimation, 3D Face Rotation and Replacement

We present an unsupervised approach for learning to estimate three dimen...

Hybrid Approach for 3D Head Reconstruction: Using Neural Networks and Visual Geometry

Recovering the 3D geometric structure of a face from a single input imag...

Adaptive Gradient Balancing for UndersampledMRI Reconstruction and Image-to-Image Translation

Recent accelerated MRI reconstruction models have used Deep Neural Netwo...

Exploring the Limits of Synthetic Creation of Solar EUV Images via Image-to-Image Translation

The Solar Dynamics Observatory (SDO), a NASA multi-spectral decade-long ...

Photorealistic Lip Sync with Adversarial Temporal Convolutional Networks

Lip sync has emerged as a promising technique to generate mouth movement...