Improving Generative Adversarial Networks with Local Coordinate Coding

07/28/2020
by   Jiezhang Cao, et al.
4

Generative adversarial networks (GANs) have shown remarkable success in generating realistic data from some predefined prior distribution (e.g., Gaussian noises). However, such prior distribution is often independent of real data and thus may lose semantic information (e.g., geometric structure or content in images) of data. In practice, the semantic information might be represented by some latent distribution learned from data. However, such latent distribution may incur difficulties in data sampling for GANs. In this paper, rather than sampling from the predefined prior distribution, we propose an LCCGAN model with local coordinate coding (LCC) to improve the performance of generating data. First, we propose an LCC sampling method in LCCGAN to sample meaningful points from the latent manifold. With the LCC sampling method, we can exploit the local information on the latent manifold and thus produce new data with promising quality. Second, we propose an improved version, namely LCCGAN++, by introducing a higher-order term in the generator approximation. This term is able to achieve better approximation and thus further improve the performance. More critically, we derive the generalization bound for both LCCGAN and LCCGAN++ and prove that a low-dimensional input is sufficient to achieve good generalization performance. Extensive experiments on four benchmark datasets demonstrate the superiority of the proposed method over existing GANs.

READ FULL TEXT

page 7

page 8

page 9

page 10

page 11

page 12

page 20

06/13/2018

Adversarial Learning with Local Coordinate Coding

Generative adversarial networks (GANs) aim to generate realistic data fr...
07/01/2021

Reparameterized Sampling for Generative Adversarial Networks

Recently, sampling methods have been successfully applied to enhance the...
11/22/2018

MR-GAN: Manifold Regularized Generative Adversarial Networks

Despite the growing interest in generative adversarial networks (GANs), ...
06/03/2018

Disconnected Manifold Learning for Generative Adversarial Networks

Real images often lie on a union of disjoint manifolds rather than one g...
06/30/2020

PriorGAN: Real Data Prior for Generative Adversarial Nets

Generative adversarial networks (GANs) have achieved rapid progress in l...
03/12/2018

Correction by Projection: Denoising Images with Generative Adversarial Networks

Generative adversarial networks (GANs) transform low-dimensional latent ...
11/19/2018

Bayesian CycleGAN via Marginalizing Latent Sampling

Recent techniques built on Generative Adversarial Networks (GANs) like C...