Manifold Learning Benefits GANs

12/23/2021
by   Yao Ni, et al.
32

In this paper, we improve Generative Adversarial Networks by incorporating a manifold learning step into the discriminator. We consider locality-constrained linear and subspace-based manifolds, and locality-constrained non-linear manifolds. In our design, the manifold learning and coding steps are intertwined with layers of the discriminator, with the goal of attracting intermediate feature representations onto manifolds. We adaptively balance the discrepancy between feature representations and their manifold view, which represents a trade-off between denoising on the manifold and refining the manifold. We conclude that locality-constrained non-linear manifolds have the upper hand over linear manifolds due to their non-uniform density and smoothness. We show substantial improvements over different recent state-of-the-art baselines.

READ FULL TEXT

page 15

page 18

page 19

page 20

page 21

page 22

page 23

page 24

research
01/24/2019

Generating and Aligning from Data Geometries with Generative Adversarial Networks

Unsupervised domain mapping has attracted substantial attention in recen...
research
01/24/2022

Neural Manifold Clustering and Embedding

Given a union of non-linear manifolds, non-linear subspace clustering or...
research
01/04/2023

Unsupervised Manifold Linearizing and Clustering

Clustering data lying close to a union of low-dimensional manifolds, wit...
research
06/22/2022

Neural Implicit Manifold Learning for Topology-Aware Generative Modelling

Natural data observed in ℝ^n is often constrained to an m-dimensional ma...
research
03/01/2017

Stochastic Development Regression on Non-Linear Manifolds

We introduce a regression model for data on non-linear manifolds. The mo...
research
06/01/2020

Emergence of Separable Manifolds in Deep Language Representations

Deep neural networks (DNNs) have shown much empirical success in solving...
research
03/11/2021

For Manifold Learning, Deep Neural Networks can be Locality Sensitive Hash Functions

It is well established that training deep neural networks gives useful r...

Please sign up or login with your details

Forgot password? Click here to reset