Force-in-domain GAN inversion

07/13/2021
by   Guangjie Leng, et al.
0

Empirical works suggest that various semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to generate images. To perform real image editing, it requires an accurate mapping from the real image to the latent space to leveraging these learned semantics, which is important yet difficult. An in-domain GAN inversion approach is recently proposed to constraint the inverted code within the latent space by forcing the reconstructed image obtained from the inverted code within the real image space. Empirically, we find that the inverted code by the in-domain GAN can deviate from the latent space significantly. To solve this problem, we propose a force-in-domain GAN based on the in-domain GAN, which utilizes a discriminator to force the inverted code within the latent space. The force-in-domain GAN can also be interpreted by a cycle-GAN with slight modification. Extensive experiments show that our force-in-domain GAN not only reconstructs the target image at the pixel level, but also align the inverted code with the latent space well for semantic editing.

READ FULL TEXT

page 4

page 5

page 6

research
03/31/2020

In-Domain GAN Inversion for Real Image Editing

Recent work has shown that a variety of controllable semantics emerges i...
research
08/20/2021

GAN Inversion for Out-of-Range Images with Geometric Transformations

For successful semantic editing of real images, it is critical for a GAN...
research
08/31/2023

Robust GAN inversion

Recent advancements in real image editing have been attributed to the ex...
research
04/06/2021

ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement

Recently, the power of unconditional image synthesis has significantly a...
research
10/12/2021

Real Image Inversion via Segments

In this short report, we present a simple, yet effective approach to edi...
research
05/05/2020

Effect of The Latent Structure on Clustering with GANs

Generative adversarial networks (GANs) have shown remarkable success in ...
research
06/16/2022

Spatially-Adaptive Multilayer Selection for GAN Inversion and Editing

Existing GAN inversion and editing methods work well for aligned objects...

Please sign up or login with your details

Forgot password? Click here to reset