LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions

04/02/2021
by   Oğuz Kaan Yüksel, et al.
0

Recent research has shown great potential for finding interpretable directions in the latent spaces of pre-trained Generative Adversarial Networks (GANs). These directions provide controllable generation and support a wide range of semantic editing operations such as zoom or rotation. The discovery of such directions is often performed in a supervised or semi-supervised fashion and requires manual annotations, limiting their applications in practice. In comparison, unsupervised discovery enables finding subtle directions a priori hard to recognize. In this work, we propose a contrastive-learning-based approach for discovering semantic directions in the latent space of pretrained GANs in a self-supervised manner. Our approach finds semantically meaningful dimensions compatible with state-of-the-art methods.

READ FULL TEXT

page 1

page 5

page 6

page 7

research
03/20/2023

Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Models

Denoising Diffusion Models (DDMs) have emerged as a strong competitor to...
research
02/10/2020

Unsupervised Discovery of Interpretable Directions in the GAN Latent Space

The latent spaces of typical GAN models often have semantically meaningf...
research
12/16/2021

Self-supervised Enhancement of Latent Discovery in GANs

Several methods for discovering interpretable directions in the latent s...
research
03/16/2022

Fantastic Style Channels and Where to Find Them: A Submodular Framework for Discovering Diverse Directions in GANs

The discovery of interpretable directions in the latent spaces of pre-tr...
research
11/27/2020

Navigating the GAN Parameter Space for Semantic Image Editing

Generative Adversarial Networks (GANs) are currently an indispensable to...
research
12/20/2020

Latent Compass: Creation by Navigation

In Marius von Senden's Space and Sight, a newly sighted blind patient de...
research
07/13/2020

Closed-Form Factorization of Latent Semantics in GANs

A rich set of semantic attributes has been shown to emerge in the latent...

Please sign up or login with your details

Forgot password? Click here to reset