How to train your conditional GAN: An approach using geometrically structured latent manifolds

11/25/2020
by   Sameera Ramasinghe, et al.
0

Conditional generative modeling typically requires capturing one-to-many mappings between the inputs and outputs. However, vanilla conditional GANs (cGAN) tend to ignore the variations of the latent seeds which results in mode-collapse. As a solution, recent works have moved towards comparatively expensive models for generating diverse outputs in a conditional setting. In this paper, we argue that the limited diversity of the vanilla cGANs is not due to a lack of capacity, but a result of non-optimal training schemes. We tackle this problem from a geometrical perspective and propose a novel training mechanism that increases both the diversity and the visual quality of the vanilla cGAN. The proposed solution does not demand architectural modifications and paves the way for more efficient architectures that target conditional generation in multi-modal spaces. We validate the efficacy of our model against a diverse set of tasks and show that the proposed solution is generic and effective across multiple datasets.

READ FULL TEXT

page 7

page 15

page 16

page 17

page 18

page 20

page 21

page 22

research
01/25/2019

Diversity-Sensitive Conditional Generative Adversarial Networks

We propose a simple yet highly effective method that addresses the mode-...
research
07/04/2022

Selectively increasing the diversity of GAN-generated samples

Generative Adversarial Networks (GANs) are powerful models able to synth...
research
03/13/2019

Mode Seeking Generative Adversarial Networks for Diverse Image Synthesis

Most conditional generation tasks expect diverse outputs given a single ...
research
08/03/2018

Diverse Conditional Image Generation by Stochastic Regression with Latent Drop-Out Codes

Recent advances in Deep Learning and probabilistic modeling have led to ...
research
10/07/2020

Conditional Generative Modeling via Learning the Latent Space

Although deep learning has achieved appealing results on several machine...
research
07/25/2020

Modal Uncertainty Estimation via Discrete Latent Representation

Many important problems in the real world don't have unique solutions. I...
research
10/25/2019

Multimodal Image Outpainting With Regularized Normalized Diversification

In this paper, we study the problem of generating a set ofrealistic and ...

Please sign up or login with your details

Forgot password? Click here to reset