HGAN: Hybrid Generative Adversarial Network

02/07/2021
by   Seyed Mehdi Iranmanesh, et al.
0

In this paper, we present a simple approach to train Generative Adversarial Networks (GANs) in order to avoid a mode collapse issue. Implicit models such as GANs tend to generate better samples compared to explicit models that are trained on tractable data likelihood. However, GANs overlook the explicit data density characteristics which leads to undesirable quantitative evaluations and mode collapse. To bridge this gap, we propose a hybrid generative adversarial network (HGAN) for which we can enforce data density estimation via an autoregressive model and support both adversarial and likelihood framework in a joint training manner which diversify the estimated density in order to cover different modes. We propose to use an adversarial network to transfer knowledge from an autoregressive model (teacher) to the generator (student) of a GAN model. A novel deep architecture within the GAN formulation is developed to adversarially distill the autoregressive model information in addition to simple GAN training approach. We conduct extensive experiments on real-world datasets (i.e., MNIST, CIFAR-10, STL-10) to demonstrate the effectiveness of the proposed HGAN under qualitative and quantitative evaluations. The experimental results show the superiority and competitiveness of our method compared to the baselines.

READ FULL TEXT

page 4

page 6

research
05/24/2017

Flow-GAN: Bridging implicit and prescribed learning in generative models

Evaluating the performance of generative models for unsupervised learnin...
research
09/16/2023

Music Generation based on Generative Adversarial Networks with Transformer

Autoregressive models based on Transformers have become the prevailing a...
research
02/14/2020

Top-K Training of GANs: Improving Generators by Making Critics Less Critical

We introduce a simple (one line of code) modification to the Generative ...
research
04/09/2019

A New GAN-based End-to-End TTS Training Algorithm

End-to-end, autoregressive model-based TTS has shown significant perform...
research
09/12/2017

Dual Discriminator Generative Adversarial Nets

We propose in this paper a novel approach to tackle the problem of mode ...
research
07/10/2018

Learning Implicit Generative Models by Teaching Explicit Ones

Implicit generative models are difficult to train as no explicit probabi...
research
04/21/2020

Decomposed Adversarial Learned Inference

Effective inference for a generative adversarial model remains an import...

Please sign up or login with your details

Forgot password? Click here to reset