Navigating the GAN Parameter Space for Semantic Image Editing

11/27/2020
by   Anton Cherepkov, et al.
0

Generative Adversarial Networks (GANs) are currently an indispensable tool for visual editing, being a standard component of image-to-image translation and image restoration pipelines. Furthermore, GANs are especially useful for controllable generation since their latent spaces contain a wide range of interpretable directions, well suited for semantic editing operations. By gradually changing latent codes along these directions, one can produce impressive visual effects, unattainable without GANs. In this paper, we significantly expand the range of visual effects achievable with the state-of-the-art models, like StyleGAN2. In contrast to existing works, which mostly operate by latent codes, we discover interpretable directions in the space of the generator parameters. By several simple methods, we explore this space and demonstrate that it also contains a plethora of interpretable directions, which are an excellent source of non-trivial semantic manipulations. The discovered manipulations cannot be achieved by transforming the latent codes and can be used to edit both synthetic and real images. We release our code and models and hope they will serve as a handy tool for further efforts on GAN-based image editing.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

page 11

page 12

page 13

research
08/26/2022

User-Controllable Latent Transformer for StyleGAN Image Layout Editing

Latent space exploration is a technique that discovers interpretable lat...
research
04/02/2021

LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions

Recent research has shown great potential for finding interpretable dire...
research
01/31/2023

GANravel: User-Driven Direction Disentanglement in Generative Adversarial Networks

Generative adversarial networks (GANs) have many application areas inclu...
research
02/23/2022

Discovering Multiple and Diverse Directions for Cognitive Image Properties

Recent research has shown that it is possible to find interpretable dire...
research
04/06/2020

GANSpace: Discovering Interpretable GAN Controls

This paper describes a simple technique to analyze Generative Adversaria...
research
07/17/2020

Unsupervised Controllable Generation with Self-Training

Recent generative adversarial networks (GANs) are able to generate impre...
research
07/17/2022

GANzilla: User-Driven Direction Discovery in Generative Adversarial Networks

Generative Adversarial Network (GAN) is widely adopted in numerous appli...

Please sign up or login with your details

Forgot password? Click here to reset