A naive method to discover directions in the StyleGAN2 latent space

03/19/2022
by   Andrea Giardina, et al.
0

Several research groups have shown that Generative Adversarial Networks (GANs) can generate photo-realistic images in recent years. Using the GANs, a map is created between a latent code and a photo-realistic image. This process can also be reversed: given a photo as input, it is possible to obtain the corresponding latent code. In this paper, we will show how the inversion process can be easily exploited to interpret the latent space and control the output of StyleGAN2, a GAN architecture capable of generating photo-realistic faces. From a biological perspective, facial features such as nose size depend on important genetic factors, and we explore the latent spaces that correspond to such biological features, including masculinity and eye colour. We show the results obtained by applying the proposed method to a set of photos extracted from the CelebA-HQ database. We quantify some of these measures by utilizing two landmarking protocols, and evaluate their robustness through statistical analysis. Finally we correlate these measures with the input parameters used to perturb the latent spaces along those interpretable directions. Our results contribute towards building the groundwork of using such GAN architecture in forensics to generate photo-realistic faces that satisfy certain biological attributes.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 13

page 14

research
07/25/2019

Interpreting the Latent Space of GANs for Semantic Face Editing

Despite the recent advance of Generative Adversarial Networks (GANs) in ...
research
04/12/2021

Diamond in the rough: Improving image realism by traversing the GAN latent space

In just a few years, the photo-realism of images synthesized by Generati...
research
05/06/2022

LatentKeypointGAN: Controlling Images via Latent Keypoints – Extended Abstract

Generative adversarial networks (GANs) can now generate photo-realistic ...
research
04/17/2022

StyleT2F: Generating Human Faces from Textual Description Using StyleGAN2

AI-driven image generation has improved significantly in recent years. G...
research
03/24/2019

SRGAN: Training Dataset Matters

Generative Adversarial Networks (GANs) in supervised settings can genera...
research
10/11/2020

Resolution Dependant GAN Interpolation for Controllable Image Synthesis Between Domains

GANs can generate photo-realistic images from the domain of their traini...
research
03/29/2021

LatentKeypointGAN: Controlling GANs via Latent Keypoints

Generative adversarial networks (GANs) have attained photo-realistic qua...

Please sign up or login with your details

Forgot password? Click here to reset