Image Augmentations for GAN Training

06/04/2020
by   Zhengli Zhao, et al.
18

Data augmentations have been widely studied to improve the accuracy and robustness of classifiers. However, the potential of image augmentation in improving GAN models for image synthesis has not been thoroughly investigated in previous studies. In this work, we systematically study the effectiveness of various existing augmentation techniques for GAN training in a variety of settings. We provide insights and guidelines on how to augment images for both vanilla GANs and GANs with regularizations, improving the fidelity of the generated images substantially. Surprisingly, we find that vanilla GANs attain generation quality on par with recent state-of-the-art results if we use augmentations on both real and generated images. When this GAN training is combined with other augmentation-based regularization techniques, such as contrastive loss and consistency regularization, the augmentations further improve the quality of generated images. We provide new state-of-the-art results for conditional generation on CIFAR-10 with both consistency loss and contrastive loss as additional regularizations.

READ FULL TEXT

page 2

page 14

page 15

page 16

page 17

page 19

research
06/18/2020

Differentiable Augmentation for Data-Efficient GAN Training

The performance of generative adversarial networks (GANs) heavily deteri...
research
10/19/2020

LT-GAN: Self-Supervised GAN with Latent Transformation Detection

Generative Adversarial Networks (GANs) coupled with self-supervised task...
research
02/23/2022

When do GANs replicate? On the choice of dataset size

Do GANs replicate training images? Previous studies have shown that GANs...
research
11/25/2020

Improving Augmentation and Evaluation Schemes for Semantic Image Synthesis

Despite data augmentation being a de facto technique for boosting the pe...
research
02/11/2020

Improved Consistency Regularization for GANs

Recent work has increased the performance of Generative Adversarial Netw...
research
12/27/2022

General GAN-generated image detection by data augmentation in fingerprint domain

In this work, we investigate improving the generalizability of GAN-gener...
research
04/06/2020

Leveraging GANs to Improve Continuous Path Keyboard Input Models

Continuous path keyboard input has higher inherent ambiguity than standa...

Please sign up or login with your details

Forgot password? Click here to reset