Self-supervised Enhancement of Latent Discovery in GANs

Several methods for discovering interpretable directions in the latent space of pre-trained GANs have been proposed. Latent semantics discovered by unsupervised methods are relatively less disentangled than supervised methods since they do not use pre-trained attribute classifiers. We propose Scale Ranking Estimator (SRE), which is trained using self-supervision. SRE enhances the disentanglement in directions obtained by existing unsupervised disentanglement techniques. These directions are updated to preserve the ordering of variation within each direction in latent space. Qualitative and quantitative evaluation of the discovered directions demonstrates that our proposed method significantly improves disentanglement in various datasets. We also show that the learned SRE can be used to perform Attribute-based image retrieval task without further training.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
04/02/2021

LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions

Recent research has shown great potential for finding interpretable dire...
research
03/16/2022

Fantastic Style Channels and Where to Find Them: A Submodular Framework for Discovering Diverse Directions in GANs

The discovery of interpretable directions in the latent spaces of pre-tr...
research
07/16/2023

Householder Projector for Unsupervised Latent Semantics Discovery

Generative Adversarial Networks (GANs), especially the recent style-base...
research
07/22/2021

LARGE: Latent-Based Regression through GAN Semantics

We propose a novel method for solving regression tasks using few-shot or...
research
12/20/2020

Latent Compass: Creation by Navigation

In Marius von Senden's Space and Sight, a newly sighted blind patient de...
research
10/28/2021

Multi-Attribute Balanced Sampling for Disentangled GAN Controls

Various controls over the generated data can be extracted from the laten...
research
06/05/2022

ContraCLIP: Interpretable GAN generation driven by pairs of contrasting sentences

This work addresses the problem of discovering non-linear interpretable ...

Please sign up or login with your details

Forgot password? Click here to reset