3D Guided Fine-Grained Face Manipulation

02/24/2019
by   Zhenglin Geng, et al.
1

We present a method for fine-grained face manipulation. Given a face image with an arbitrary expression, our method can synthesize another arbitrary expression by the same person. This is achieved by first fitting a 3D face model and then disentangling the face into a texture and a shape. We then learn different networks in these two spaces. In the texture space, we use a conditional generative network to change the appearance, and carefully design input formats and loss functions to achieve the best results. In the shape space, we use a fully connected network to predict the accurate shapes and use the available depth data for supervision. Both networks are conditioned on expression coefficients rather than discrete labels, allowing us to generate an unlimited amount of expressions. We show the superiority of this disentangling approach through both quantitative and qualitative studies. In a user study, our method is preferred in 85 When compared to the ground truth, annotators cannot reliably distinguish between our synthesized images and real images, preferring our method in 53 the cases.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 11

page 12

page 13

research
04/21/2020

Fine-Grained Expression Manipulation via Structured Latent Space

Fine-grained facial expression manipulation is a challenging problem, as...
research
11/22/2019

DLGAN: Disentangling Label-Specific Fine-Grained Features for Image Manipulation

Several recent studies have shown how disentangling images into content ...
research
09/06/2019

Explicit Facial Expression Transfer via Fine-Grained Semantic Representations

Facial expression transfer between two unpaired images is a challenging ...
research
06/16/2022

Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields

Capitalizing on the recent advances in image generation models, existing...
research
03/28/2019

High Fidelity Face Manipulation with Extreme Pose and Expression

Face manipulation has shown remarkable advances with the flourish of Gen...
research
08/13/2020

Modeling Caricature Expressions by 3D Blendshape and Dynamic Texture

The problem of deforming an artist-drawn caricature according to a given...
research
09/13/2018

3D Face Hallucination from a Single Depth Frame

We present an algorithm that takes a single frame of a person's face fro...

Please sign up or login with your details

Forgot password? Click here to reset