Attribute-Specific Manipulation Based on Layer-Wise Channels

02/18/2023
by   Yuanjie Yan, et al.
0

Image manipulation on the latent space of the pre-trained StyleGAN can control the semantic attributes of the generated images. Recently, some studies have focused on detecting channels with specific properties to directly manipulate the latent code, which is limited by the entanglement of the latent space. To detect the attribute-specific channels, we propose a novel detection method in the context of pre-trained classifiers. We analyse the gradients layer by layer on the style space. The intensities of the gradients indicate the channel's responses to specific attributes. The latent style codes of channels control separate attributes in the layers. We choose channels with top-k gradients to control specific attributes in the maximum response layer. We implement single-channel and multi-channel manipulations with a certain attribute. Our methods can accurately detect relevant channels for a large number of face attributes. Extensive qualitative and quantitative results demonstrate that the proposed methods outperform state-of-the-art methods in generalization and scalability.

READ FULL TEXT

page 15

page 18

page 29

page 30

page 31

page 32

page 33

page 34

research
07/20/2022

Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space Exploration

Unconstrained Image generation with high realism is now possible using r...
research
07/26/2019

Latent Space Factorisation and Manipulation via Matrix Subspace Projection

This paper proposes a novel method for factorising the information in th...
research
11/25/2020

StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation

We explore and analyze the latent style space of StyleGAN2, a state-of-t...
research
07/12/2023

DiffuseGAE: Controllable and High-fidelity Image Manipulation from Disentangled Representation

Diffusion probabilistic models (DPMs) have shown remarkable results on v...
research
01/11/2019

Variation Network: Learning High-level Attributes for Controlled Input Manipulation

This paper presents the Variation Network (VarNet), a generative model p...
research
02/26/2023

Learning Input-agnostic Manipulation Directions in StyleGAN with Text Guidance

With the advantages of fast inference and human-friendly flexible manipu...
research
09/01/2022

Exploring Gradient-based Multi-directional Controls in GANs

Generative Adversarial Networks (GANs) have been widely applied in model...

Please sign up or login with your details

Forgot password? Click here to reset