FaceFeat-GAN: a Two-Stage Approach for Identity-Preserving Face Synthesis

12/04/2018
by   Yujun Shen, et al.
8

The advance of Generative Adversarial Networks (GANs) enables realistic face image synthesis. However, synthesizing face images that preserve facial identity as well as have high diversity within each identity remains challenging. To address this problem, we present FaceFeat-GAN, a novel generative model that improves both image quality and diversity by using two stages. Unlike existing single-stage models that map random noise to image directly, our two-stage synthesis includes the first stage of diverse feature generation and the second stage of feature-to-image rendering. The competitions between generators and discriminators are carefully designed in both stages with different objective functions. Specially, in the first stage, they compete in the feature domain to synthesize various facial features rather than images. In the second stage, they compete in the image domain to render photo-realistic images that contain high diversity but preserve identity. Extensive experiments show that FaceFeat-GAN generates images that not only retain identity information but also have high diversity and quality, significantly outperforming previous methods.

READ FULL TEXT

page 1

page 7

page 8

page 12

research
06/10/2017

Generate Identity-Preserving Faces by Generative Adversarial Networks

Generating identity-preserving faces aims to generate various face image...
research
02/21/2018

Load Balanced GANs for Multi-view Face Image Synthesis

Multi-view face synthesis from a single image is an ill-posed problem an...
research
03/28/2022

TL-GAN: Improving Traffic Light Recognition via Data Synthesis for Autonomous Driving

Traffic light recognition, as a critical component of the perception mod...
research
11/17/2018

On Hallucinating Context and Background Pixels from a Face Mask using Multi-scale GANs

We propose a multi-scale GAN model to hallucinate realistic context (for...
research
08/24/2022

3D-FM GAN: Towards 3D-Controllable Face Manipulation

3D-controllable portrait synthesis has significantly advanced, thanks to...
research
06/10/2020

Speech Fusion to Face: Bridging the Gap Between Human's Vocal Characteristics and Facial Imaging

While deep learning technologies are now capable of generating realistic...
research
03/31/2020

Learning Generative Models of Tissue Organization with Supervised GANs

A key step in understanding the spatial organization of cells and tissue...

Please sign up or login with your details

Forgot password? Click here to reset