Feature-Style Encoder for Style-Based GAN Inversion

02/04/2022
by   Xu Yao, et al.
0

We propose a novel architecture for GAN inversion, which we call Feature-Style encoder. The style encoder is key for the manipulation of the obtained latent codes, while the feature encoder is crucial for optimal image reconstruction. Our model achieves accurate inversion of real images from the latent space of a pre-trained style-based GAN model, obtaining better perceptual quality and lower reconstruction error than existing methods. Thanks to its encoder structure, the model allows fast and accurate image editing. Additionally, we demonstrate that the proposed encoder is especially well-suited for inversion and editing on videos. We conduct extensive experiments for several style-based generators pre-trained on different data domains. Our proposed method yields state-of-the-art results for style-based GAN inversion, significantly outperforming competing approaches. Source codes are available at https://github.com/InterDigitalInc/FeatureStyleEncoder .

READ FULL TEXT

page 14

page 15

page 18

page 19

page 20

page 21

page 22

page 24

research
08/20/2021

GAN Inversion for Out-of-Range Images with Geometric Transformations

For successful semantic editing of real images, it is critical for a GAN...
research
10/17/2021

AE-StyleGAN: Improved Training of Style-Based Auto-Encoders

StyleGANs have shown impressive results on data generation and manipulat...
research
07/30/2023

StylePrompter: All Styles Need Is Attention

GAN inversion aims at inverting given images into corresponding latent c...
research
12/01/2021

HyperInverter: Improving StyleGAN Inversion via Hypernetwork

Real-world image manipulation has achieved fantastic progress in recent ...
research
11/12/2022

3D-Aware Encoding for Style-based Neural Radiance Fields

We tackle the task of NeRF inversion for style-based neural radiance fie...
research
12/17/2021

SuperStyleNet: Deep Image Synthesis with Superpixel Based Style Encoder

Existing methods for image synthesis utilized a style encoder based on s...
research
07/20/2022

Monocular 3D Object Reconstruction with GAN Inversion

Recovering a textured 3D mesh from a monocular image is highly challengi...

Please sign up or login with your details

Forgot password? Click here to reset