FaceDet3D: Facial Expressions with 3D Geometric Detail Prediction

by   ShahRukh Athar, et al.

Facial Expressions induce a variety of high-level details on the 3D face geometry. For example, a smile causes the wrinkling of cheeks or the formation of dimples, while being angry often causes wrinkling of the forehead. Morphable Models (3DMMs) of the human face fail to capture such fine details in their PCA-based representations and consequently cannot generate such details when used to edit expressions. In this work, we introduce FaceDet3D, a first-of-its-kind method that generates - from a single image - geometric facial details that are consistent with any desired target expression. The facial details are represented as a vertex displacement map and used then by a Neural Renderer to photo-realistically render novel images of any single image in any desired expression and view. The Project website is: http://shahrukhathar.github.io/2020/12/14/FaceDet3D.html



There are no comments yet.


page 5

page 7

page 8


Photo-Realistic Facial Details Synthesis from Single Immage

We present a single-image 3D face synthesis technique that can handle ch...

FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction

In this paper, we present a large-scale detailed 3D face dataset, FaceSc...

SIDER: Single-Image Neural Optimization for Facial Geometric Detail Recovery

We present SIDER(Single-Image neural optimization for facial geometric D...

Lightweight Photometric Stereo for Facial Details Recovery

Recently, 3D face reconstruction from a single image has achieved great ...

Face Video Generation from a Single Image and Landmarks

In this paper we are concerned with the challenging problem of producing...

CycleGAN Face-off

Face-off is an interesting case of style transfer where the facial expre...

Towards High Fidelity Face Relighting with Realistic Shadows

Existing face relighting methods often struggle with two problems: maint...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.