Exploring Semantic Variations in GAN Latent Spaces via Matrix Factorization

05/23/2023
by   Andrey Palaev, et al.
0

Controlled data generation with GANs is desirable but challenging due to the nonlinearity and high dimensionality of their latent spaces. In this work, we explore image manipulations learned by GANSpace, a state-of-the-art method based on PCA. Through quantitative and qualitative assessments we show: (a) GANSpace produces a wide range of high-quality image manipulations, but they can be highly entangled, limiting potential use cases; (b) Replacing PCA with ICA improves the quality and disentanglement of manipulations; (c) The quality of the generated images can be sensitive to the size of GANs, but regardless of their complexity, fundamental controlling directions can be observed in their latent spaces.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 9

page 10

research
06/13/2022

Exploring and Exploiting Hubness Priors for High-Quality GAN Latent Sampling

Despite the extensive studies on Generative Adversarial Networks (GANs),...
research
01/31/2022

Finding Directions in GAN's Latent Space for Neural Face Reenactment

This paper is on face/head reenactment where the goal is to transfer the...
research
11/28/2020

Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANs

While Generative Adversarial Networks (GANs) show increasing performance...
research
12/13/2021

Exploring Latent Dimensions of Crowd-sourced Creativity

Recently, the discovery of interpretable directions in the latent spaces...
research
11/29/2021

Latent Transformations via NeuralODEs for GAN-based Image Editing

Recent advances in high-fidelity semantic image editing heavily rely on ...
research
07/22/2021

LARGE: Latent-Based Regression through GAN Semantics

We propose a novel method for solving regression tasks using few-shot or...
research
10/15/2020

Interactive Latent Interpolation on MNIST Dataset

This paper will discuss the potential of dimensionality reduction with a...

Please sign up or login with your details

Forgot password? Click here to reset