StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation

11/25/2020
by   Zongze Wu, et al.
12

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style parameters, is significantly more disentangled than the other intermediate latent spaces explored by previous works. Next, we describe a method for discovering a large collection of style channels, each of which is shown to control a distinct visual attribute in a highly localized and disentangled manner. Third, we propose a simple method for identifying style channels that control a specific attribute, using a pretrained classifier or a small number of example images. Manipulation of visual attributes via these StyleSpace controls is shown to be better disentangled than via those proposed in previous works. To show this, we make use of a newly proposed Attribute Dependency metric. Finally, we demonstrate the applicability of StyleSpace controls to the manipulation of real images. Our findings pave the way to semantically meaningful and well-disentangled image manipulations via simple and intuitive interfaces.

READ FULL TEXT

page 5

page 6

page 13

page 19

page 22

page 23

page 24

page 25

research
07/20/2022

Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space Exploration

Unconstrained Image generation with high realism is now possible using r...
research
07/12/2023

DiffuseGAE: Controllable and High-fidelity Image Manipulation from Disentangled Representation

Diffusion probabilistic models (DPMs) have shown remarkable results on v...
research
03/09/2023

StyleDiff: Attribute Comparison Between Unlabeled Datasets in Latent Disentangled Space

One major challenge in machine learning applications is coping with mism...
research
02/18/2023

Attribute-Specific Manipulation Based on Layer-Wise Channels

Image manipulation on the latent space of the pre-trained StyleGAN can c...
research
05/30/2023

DualVAE: Controlling Colours of Generated and Real Images

Colour controlled image generation and manipulation are of interest to a...
research
08/07/2022

Hierarchical Semantic Regularization of Latent Spaces in StyleGANs

Progress in GANs has enabled the generation of high-resolution photoreal...
research
03/16/2022

Fantastic Style Channels and Where to Find Them: A Submodular Framework for Discovering Diverse Directions in GANs

The discovery of interpretable directions in the latent spaces of pre-tr...

Please sign up or login with your details

Forgot password? Click here to reset