A Wasserstein GAN model with the total variational regularization

12/03/2018
by   Moshe Y. Vardi, et al.
0

It is well known that the generative adversarial nets (GANs) are remarkably difficult to train. The recently proposed Wasserstein GAN (WGAN) creates principled research directions towards addressing these issues. But we found in practice that gradient penalty WGANs (GP-WGANs) still suffer from training instability. In this paper, we combine a Total Variational (TV) regularizing term into the WGAN formulation instead of weight clipping or gradient penalty, which implies that the Lipschitz constraint is enforced on the critic network. Our proposed method is more stable at training than GP-WGANs and works well across varied GAN architectures. We also present a method to control the trade-off between image diversity and visual quality. It does not bring any computation burden.

READ FULL TEXT

page 5

page 6

research
03/16/2018

Varying k-Lipschitz Constraint for Generative Adversarial Networks

Generative Adversarial Networks (GANs) are powerful generative models, b...
research
03/31/2017

Improved Training of Wasserstein GANs

Generative Adversarial Networks (GANs) are powerful generative models, b...
research
05/06/2017

Face Super-Resolution Through Wasserstein GANs

Generative adversarial networks (GANs) have received a tremendous amount...
research
05/29/2018

On gradient regularizers for MMD GANs

We propose a principled method for gradient-based regularization of the ...
research
07/02/2018

Understanding the Effectiveness of Lipschitz Constraint in Training of GANs via Gradient Analysis

This paper aims to bring a new perspective for understanding GANs, by de...
research
04/26/2022

Application of WGAN-GP in recommendation and Questioning the relevance of GAN-based approaches

Many neural-based recommender systems were proposed in recent years and ...
research
05/31/2021

The use of Generative Adversarial Networks to characterise new physics in multi-lepton final states at the LHC

Semi-supervision in Machine Learning can be used in searches for new phy...

Please sign up or login with your details

Forgot password? Click here to reset