LaFIn: Generative Landmark Guided Face Inpainting

by   Yang Yang, et al.

It is challenging to inpaint face images in the wild, due to the large variation of appearance, such as different poses, expressions and occlusions. A good inpainting algorithm should guarantee the realism of output, including the topological structure among eyes, nose and mouth, as well as the attribute consistency on pose, gender, ethnicity, expression, etc. This paper studies an effective deep learning based strategy to deal with these issues, which comprises of a facial landmark predicting subnet and an image inpainting subnet. Concretely, given partial observation, the landmark predictor aims to provide the structural information (e.g. topological relationship and expression) of incomplete faces, while the inpaintor is to generate plausible appearance (e.g. gender and ethnicity) conditioned on the predicted landmarks. Experiments on the CelebA-HQ and CelebA datasets are conducted to reveal the efficacy of our design and, to demonstrate its superiority over state-of-the-art alternatives both qualitatively and quantitatively. In addition, we assume that high-quality completed faces together with their landmarks can be utilized as augmented data to further improve the performance of (any) landmark predictor, which is corroborated by experimental results on the 300W and WFLW datasets.


page 1

page 6

page 7

page 12

page 13

page 14

page 15

page 16


LI-Net: Large-Pose Identity-Preserving Face Reenactment Network

Face reenactment is a challenging task, as it is difficult to maintain a...

A Deep Learning Framework to Reconstruct Face under Mask

While deep learning-based image reconstruction methods have shown signif...

Landmark Assisted CycleGAN for Cartoon Face Generation

In this paper, we are interested in generating an cartoon face of a pers...

Which Facial Expressions Can Reveal Your Gender? A Study With 3D Faces

Human exhibit rich gender cues in both appearance and behavior. In compu...

Facial Expression Translation using Landmark Guided GANs

We propose a simple yet powerful Landmark guided Generative Adversarial ...

A recurrent cycle consistency loss for progressive face-to-face synthesis

This paper addresses a major flaw of the cycle consistency loss when use...

Think about boundary: Fusing multi-level boundary information for landmark heatmap regression

Although current face alignment algorithms have obtained pretty good per...

Please sign up or login with your details

Forgot password? Click here to reset