Improving Generative Adversarial Networks with Local Coordinate Coding

by   Jiezhang Cao, et al.

Generative adversarial networks (GANs) have shown remarkable success in generating realistic data from some predefined prior distribution (e.g., Gaussian noises). However, such prior distribution is often independent of real data and thus may lose semantic information (e.g., geometric structure or content in images) of data. In practice, the semantic information might be represented by some latent distribution learned from data. However, such latent distribution may incur difficulties in data sampling for GANs. In this paper, rather than sampling from the predefined prior distribution, we propose an LCCGAN model with local coordinate coding (LCC) to improve the performance of generating data. First, we propose an LCC sampling method in LCCGAN to sample meaningful points from the latent manifold. With the LCC sampling method, we can exploit the local information on the latent manifold and thus produce new data with promising quality. Second, we propose an improved version, namely LCCGAN++, by introducing a higher-order term in the generator approximation. This term is able to achieve better approximation and thus further improve the performance. More critically, we derive the generalization bound for both LCCGAN and LCCGAN++ and prove that a low-dimensional input is sufficient to achieve good generalization performance. Extensive experiments on four benchmark datasets demonstrate the superiority of the proposed method over existing GANs.


page 7

page 8

page 9

page 10

page 11

page 12

page 20


Adversarial Learning with Local Coordinate Coding

Generative adversarial networks (GANs) aim to generate realistic data fr...

Reparameterized Sampling for Generative Adversarial Networks

Recently, sampling methods have been successfully applied to enhance the...

MR-GAN: Manifold Regularized Generative Adversarial Networks

Despite the growing interest in generative adversarial networks (GANs), ...

Disconnected Manifold Learning for Generative Adversarial Networks

Real images often lie on a union of disjoint manifolds rather than one g...

PriorGAN: Real Data Prior for Generative Adversarial Nets

Generative adversarial networks (GANs) have achieved rapid progress in l...

Correction by Projection: Denoising Images with Generative Adversarial Networks

Generative adversarial networks (GANs) transform low-dimensional latent ...

Bayesian CycleGAN via Marginalizing Latent Sampling

Recent techniques built on Generative Adversarial Networks (GANs) like C...