Are GANs Created Equal? A Large-Scale Study

11/28/2017
by   Mario Lucic, et al.
0

Generative adversarial networks (GAN) are a powerful subclass of generative models. Despite a very rich research activity leading to numerous interesting GAN algorithms, it is still very hard to assess which algorithm(s) perform better than others. We conduct a neutral, multi-faceted large-scale empirical study on state-of-the art models and evaluation measures. We find that most models can reach similar scores with enough hyperparameter optimization and random restarts. This suggests that improvements can arise from a higher computational budget and tuning more than fundamental algorithmic changes. To overcome some limitations of the current metrics, we also propose several data sets on which precision and recall can be computed. Our experimental results suggest that future GAN research should be based on more systematic and objective evaluation procedures. Finally, we did not find evidence that any of the tested algorithms consistently outperforms the original one.

READ FULL TEXT

page 15

page 16

research
10/02/2018

On Self Modulation for Generative Adversarial Networks

Training Generative Adversarial Networks (GANs) is notoriously challengi...
research
06/13/2018

On Accurate Evaluation of GANs for Language Generation

Generative Adversarial Networks (GANs) are a promising approach to langu...
research
08/30/2023

Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art

Since their inception in 2014, Generative Adversarial Networks (GANs) ha...
research
03/06/2017

Activation Maximization Generative Adversarial Nets

Class label information has been empirically proven to be very useful in...
research
02/25/2019

Wasserstein GAN Can Perform PCA

Generative Adversarial Networks (GANs) have become a powerful framework ...
research
02/09/2018

Pros and Cons of GAN Evaluation Measures

Generative models, in particular generative adverserial networks (GANs),...

Please sign up or login with your details

Forgot password? Click here to reset