Towards a Deeper Understanding of Adversarial Losses

01/25/2019
by   Hao-Wen Dong, et al.
46

Recent work has proposed various adversarial losses for training generative adversarial networks. Yet, it remains unclear what certain types of functions are valid adversarial loss functions, and how these loss functions perform against one another. In this paper, we aim to gain a deeper understanding of adversarial losses by decoupling the effects of their component functions and regularization terms. We first derive some necessary and sufficient conditions of the component functions such that the adversarial loss is a divergence-like measure between the data and the model distributions. In order to systematically compare different adversarial losses, we then propose DANTest, a new, simple framework based on discriminative adversarial networks. With this framework, we evaluate an extensive set of adversarial losses by combining different component functions and regularization approaches. This study leads to some new insights into the adversarial losses. For reproducibility, all source code is available at https://github.com/salu133445/dan .

READ FULL TEXT

page 4

page 14

research
05/27/2020

Segmentation Loss Odyssey

Loss functions are one of the crucial ingredients in deep learning-based...
research
06/06/2021

Asymmetric Loss Functions for Learning with Noisy Labels

Robust loss functions are essential for training deep neural networks wi...
research
08/08/2017

Parametric Adversarial Divergences are Good Task Losses for Generative Modeling

Generative modeling of high dimensional data like images is a notoriousl...
research
05/22/2018

Nonparametric Density Estimation under Adversarial Losses

We study minimax convergence rates of nonparametric density estimation u...
research
05/29/2017

The Principle of Logit Separation

We consider neural network training, in applications in which there are ...
research
05/24/2023

torchgfn: A PyTorch GFlowNet library

The increasing popularity of generative flow networks (GFlowNets or GFNs...
research
10/15/2021

Robustness of different loss functions and their impact on networks learning capability

Recent developments in AI have made it ubiquitous, every industry is try...

Please sign up or login with your details

Forgot password? Click here to reset