ExFaceGAN: Exploring Identity Directions in GAN's Learned Latent Space for Synthetic Identity Generation

07/11/2023
by   Fadi Boutros, et al.
0

Deep generative models have recently presented impressive results in generating realistic face images of random synthetic identities. To generate multiple samples of a certain synthetic identity, several previous works proposed to disentangle the latent space of GANs by incorporating additional supervision or regularization, enabling the manipulation of certain attributes, e.g. identity, hairstyle, pose, or expression. Most of these works require designing special loss functions and training dedicated network architectures. Others proposed to disentangle specific factors in unconditional pretrained GANs latent spaces to control their output, which also requires supervision by attribute classifiers. Moreover, these attributes are entangled in GAN's latent space, making it difficult to manipulate them without affecting the identity information. We propose in this work a framework, ExFaceGAN, to disentangle identity information in state-of-the-art pretrained GANs latent spaces, enabling the generation of multiple samples of any synthetic identity. The variations in our generated images are not limited to specific attributes as ExFaceGAN explicitly aims at disentangling identity information, while other visual attributes are randomly drawn from a learned GAN latent space. As an example of the practical benefit of our ExFaceGAN, we empirically prove that data generated by ExFaceGAN can be successfully used to train face recognition models.

READ FULL TEXT

page 1

page 6

page 8

research
10/31/2018

Generating Photo-Realistic Training Data to Improve Face Recognition Accuracy

In this paper we investigate the feasibility of using synthetic data to ...
research
09/21/2023

Face Identity-Aware Disentanglement in StyleGAN

Conditional GANs are frequently used for manipulating the attributes of ...
research
06/28/2018

High Diversity Attribute Guided Face Generation with GANs

In this work we focused on GAN-based solution for the attribute guided f...
research
11/02/2020

Learning a Deep Reinforcement Learning Policy Over the Latent Space of a Pre-trained GAN for Semantic Age Manipulation

Learning a disentangled representation of the latent space has become on...
research
12/07/2021

Generation of Non-Deterministic Synthetic Face Datasets Guided by Identity Priors

Enabling highly secure applications (such as border crossing) with face ...
research
07/22/2021

3D Shape Generation with Grid-based Implicit Functions

Previous approaches to generate shapes in a 3D setting train a GAN on th...
research
01/25/2022

Rayleigh EigenDirections (REDs): GAN latent space traversals for multidimensional features

We present a method for finding paths in a deep generative model's laten...

Please sign up or login with your details

Forgot password? Click here to reset