Domain Embedded Multi-model Generative Adversarial Networks for Image-based Face Inpainting

02/05/2020
by   Xian Zhang, et al.
8

Prior knowledge of face shape and location plays an important role in face inpainting. However, traditional facing inpainting methods mainly focus on the generated image resolution of the missing portion but without consideration of the special particularities of the human face explicitly and generally produce discordant facial parts. To solve this problem, we present a stable variational latent generative model for large inpainting of face images. We firstly represent only face regions with the latent variable space but simultaneously constraint the random vectors to offer control over the distribution of latent variables, and combine with the non-face parts textures to generate a face image with plausible contents. Two adversarial discriminators are finally used to judge whether the generated distribution is close to the real distribution or not. It can not only synthesize novel image structures but also explicitly utilize the latent space with Eigenfaces to make better predictions. Furthermore, our work better evaluates the side face impainting problem. Experiments on both CelebA and CelebA-HQ face datasets demonstrate that our proposed approach generates higher quality inpainting results than existing ones.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

page 9

research
01/24/2018

Generative Image Inpainting with Contextual Attention

Recent deep learning based approaches have shown promising results on im...
research
11/30/2018

FSNet: An Identity-Aware Generative Model for Image-based Face Swapping

This paper presents FSNet, a deep generative model for image-based face ...
research
01/09/2023

SFI-Swin: Symmetric Face Inpainting with Swin Transformer by Distinctly Learning Face Components Distributions

Image inpainting consists of filling holes or missing parts of an image....
research
11/16/2016

DeMeshNet: Blind Face Inpainting for Deep MeshFace Verification

MeshFace photos have been widely used in many Chinese business organizat...
research
03/10/2021

Face Images as Jigsaw Puzzles: Compositional Perception of Human Faces for Machines Using Generative Adversarial Networks

An important goal in human-robot-interaction (HRI) is for machines to ac...
research
02/20/2022

Non-Deterministic Face Mask Removal Based On 3D Priors

This paper presents a novel image inpainting framework for face mask rem...
research
12/08/2018

Face Completion with Semantic Knowledge and Collaborative Adversarial Learning

Unlike a conventional background inpainting approach that infers a missi...

Please sign up or login with your details

Forgot password? Click here to reset