Robust GAN inversion

08/31/2023
by   Egor Sevriugov, et al.
0

Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the latent space accurately. Existing methods that work on extended latent space W+ are unable to achieve low distortion and high editability simultaneously. To address this issue, we propose an approach which works in native latent space W and tunes the generator network to restore missing image details. We introduce a novel regularization strategy with learnable coefficients obtained by training randomized StyleGAN 2 model - WRanGAN. This method outperforms traditional approaches in terms of reconstruction quality and computational efficiency, achieving the lowest distortion with 4 times fewer parameters. Furthermore, we observe a slight improvement in the quality of constructing hyperplanes corresponding to binary image attributes. We demonstrate the effectiveness of our approach on two complex datasets: Flickr-Faces-HQ and LSUN Church.

READ FULL TEXT

page 11

page 12

page 13

page 14

page 18

page 20

page 21

page 22

research
07/13/2021

Force-in-domain GAN inversion

Empirical works suggest that various semantics emerge in the latent spac...
research
03/31/2020

In-Domain GAN Inversion for Real Image Editing

Recent work has shown that a variety of controllable semantics emerges i...
research
04/12/2021

Diamond in the rough: Improving image realism by traversing the GAN latent space

In just a few years, the photo-realism of images synthesized by Generati...
research
03/21/2022

High-fidelity GAN Inversion with Padding Space

Inverting a Generative Adversarial Network (GAN) facilitates a wide rang...
research
07/30/2023

StylePrompter: All Styles Need Is Attention

GAN inversion aims at inverting given images into corresponding latent c...
research
06/02/2021

Barbershop: GAN-based Image Compositing using Segmentation Masks

Seamlessly blending features from multiple images is extremely challengi...
research
05/12/2022

Overparameterization Improves StyleGAN Inversion

Deep generative models like StyleGAN hold the promise of semantic image ...

Please sign up or login with your details

Forgot password? Click here to reset