GP-GAN: Gender Preserving GAN for Synthesizing Faces from Landmarks

10/03/2017
by   Xing Di, et al.
0

Facial landmarks constitute the most compressed representation of faces and are known to preserve information such as pose, gender and facial structure present in the faces. Several works exist that attempt to perform high-level face-related analysis tasks based on landmarks. In contrast, in this work, an attempt is made to tackle the inverse problem of synthesizing faces from their respective landmarks. The primary aim of this work is to demonstrate that information preserved by landmarks (gender in particular) can be further accentuated by leveraging generative models to synthesize corresponding faces. Though the problem is particularly challenging due to its ill-posed nature, we believe that successful synthesis will enable several applications such as boosting performance of high-level face related tasks using landmark points and performing dataset augmentation. To this end, a novel face-synthesis method known as Gender Preserving Generative Adversarial Network (GP-GAN) that is guided by adversarial loss, perceptual loss and a gender preserving loss is presented. Further, we propose a novel generator sub-network UDeNet for GP-GAN that leverages advantages of U-Net and DenseNet architectures. Extensive experiments and comparison with recent methods are performed to verify the effectiveness of the proposed method.

READ FULL TEXT
research
10/31/2020

LandmarkGAN: Synthesizing Faces from Landmarks

Face synthesis is an important problem in computer vision with many appl...
research
10/10/2021

Fine-grained Identity Preserving Landmark Synthesis for Face Reenactment

Recent face reenactment works are limited by the coarse reference landma...
research
12/07/2020

SuperFront: From Low-resolution to High-resolution Frontal Face Synthesis

Advances in face rotation, along with other face-based generative tasks,...
research
04/22/2020

Unpaired Photo-to-manga Translation Based on The Methodology of Manga Drawing

Manga is a world popular comic form originated in Japan, which typically...
research
01/13/2022

VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting

We propose VoLux-GAN, a generative framework to synthesize 3D-aware face...
research
07/28/2017

Face Deidentification with Generative Deep Neural Networks

Face deidentification is an active topic amongst privacy and security re...
research
09/14/2018

A study on the use of Boundary Equilibrium GAN for Approximate Frontalization of Unconstrained Faces to aid in Surveillance

Face frontalization is the process of synthesizing frontal facing views ...

Please sign up or login with your details

Forgot password? Click here to reset