DeepAI AI Chat
Log In Sign Up

GANs with Variational Entropy Regularizers: Applications in Mitigating the Mode-Collapse Issue

09/24/2020
by   Pirazh Khorramshahi, et al.
0

Building on the success of deep learning, Generative Adversarial Networks (GANs) provide a modern approach to learn a probability distribution from observed samples. GANs are often formulated as a zero-sum game between two sets of functions; the generator and the discriminator. Although GANs have shown great potentials in learning complex distributions such as images, they often suffer from the mode collapse issue where the generator fails to capture all existing modes of the input distribution. As a consequence, the diversity of generated samples is lower than that of the observed ones. To tackle this issue, we take an information-theoretic approach and maximize a variational lower bound on the entropy of the generated samples to increase their diversity. We call this approach GANs with Variational Entropy Regularizers (GAN+VER). Existing remedies for the mode collapse issue in GANs can be easily coupled with our proposed variational entropy regularization. Through extensive experimentation on standard benchmark datasets, we show all the existing evaluation metrics highlighting difference of real and generated samples are significantly improved with GAN+VER.

READ FULL TEXT
07/04/2022

Selectively increasing the diversity of GAN-generated samples

Generative Adversarial Networks (GANs) are powerful models able to synth...
10/09/2018

Entropic GANs meet VAEs: A Statistical Approach to Compute Sample Likelihoods in GANs

Building on the success of deep learning, two modern approaches to learn...
02/02/2022

Structure-preserving GANs

Generative adversarial networks (GANs), a class of distribution-learning...
12/12/2017

PacGAN: The power of two samples in generative adversarial networks

Generative adversarial networks (GANs) are innovative techniques for lea...
10/09/2019

Prescribed Generative Adversarial Networks

Generative adversarial networks (GANs) are a powerful approach to unsupe...
12/08/2022

Effective Dynamics of Generative Adversarial Networks

Generative adversarial networks (GANs) are a class of machine-learning m...
05/22/2017

VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning

Deep generative models provide powerful tools for distributions over com...