Inverse mapping of face GANs

09/11/2020
by   Nicky Bayat, et al.
0

Generative adversarial networks (GANs) synthesize realistic images from a random latent vector. While many studies have explored various training configurations and architectures for GANs, the problem of inverting a generative model to extract latent vectors of given input images has been inadequately investigated. Although there is exactly one generated image per given random vector, the mapping from an image to its recovered latent vector can have more than one solution. We train a ResNet architecture to recover a latent vector for a given face that can be used to generate a face nearly identical to the target. We use a perceptual loss to embed face details in the recovered latent vector while maintaining visual quality using a pixel loss. The vast majority of studies on latent vector recovery perform well only on generated images, we argue that our method can be used to determine a mapping between real human faces and latent-space vectors that contain most of the important face style details. In addition, our proposed method projects generated faces to their latent-space with high fidelity and speed. At last, we demonstrate the performance of our approach on both real and generated faces.

READ FULL TEXT

page 3

page 4

page 5

page 6

research
04/11/2020

Autoencoding Generative Adversarial Networks

In the years since Goodfellow et al. introduced Generative Adversarial N...
research
10/16/2020

Latent Vector Recovery of Audio GANs

Advanced Generative Adversarial Networks (GANs) are remarkable in genera...
research
05/15/2021

Mask-Guided Discovery of Semantic Manifolds in Generative Models

Advances in the realm of Generative Adversarial Networks (GANs) have led...
research
07/20/2020

Bayesian optimization for automatic design of face stimuli

Investigating the cognitive and neural mechanisms involved with face pro...
research
11/19/2016

Invertible Conditional GANs for image editing

Generative Adversarial Networks (GANs) have recently demonstrated to suc...
research
01/09/2021

Exploring Adversarial Fake Images on Face Manifold

Images synthesized by powerful generative adversarial network (GAN) base...
research
01/15/2018

Unsupervised Cipher Cracking Using Discrete GANs

This work details CipherGAN, an architecture inspired by CycleGAN used f...

Please sign up or login with your details

Forgot password? Click here to reset