Guiding GANs: How to control non-conditional pre-trained GANs for conditional image generation

01/04/2021
by   Manel Mateos, et al.
7

Generative Adversarial Networks (GANs) are an arrange of two neural networks – the generator and the discriminator – that are jointly trained to generate artificial data, such as images, from random inputs. The quality of these generated images has recently reached such levels that can often lead both machines and humans into mistaking fake for real examples. However, the process performed by the generator of the GAN has some limitations when we want to condition the network to generate images from subcategories of a specific class. Some recent approaches tackle this conditional generation by introducing extra information prior to the training process, such as image semantic segmentation or textual descriptions. While successful, these techniques still require defining beforehand the desired subcategories and collecting large labeled image datasets representing them to train the GAN from scratch. In this paper we present a novel and alternative method for guiding generic non-conditional GANs to behave as conditional GANs. Instead of re-training the GAN, our approach adds into the mix an encoder network to generate the high-dimensional random input vectors that are fed to the generator network of a non-conditional GAN to make it generate images from a specific subcategory. In our experiments, when compared to training a conditional GAN from scratch, our guided GAN is able to generate artificial images of perceived quality comparable to that of non-conditional GANs after training the encoder on just a few hundreds of images, which substantially accelerates the process and enables adding new subcategories seamlessly.

READ FULL TEXT

page 9

page 11

page 13

research
09/18/2020

Conditional Image Generation with One-Vs-All Classifier

This paper explores conditional image generation with a One-Vs-All class...
research
05/22/2020

Host-Pathongen Co-evolution Inspired Algorithm Enables Robust GAN Training

Generative adversarial networks (GANs) are pairs of artificial neural ne...
research
07/16/2017

Generative Adversarial Network based on Resnet for Conditional Image Restoration

The GANs promote an adversarive game to approximate complex and jointed ...
research
12/03/2020

Self-labeled Conditional GANs

This paper introduces a novel and fully unsupervised framework for condi...
research
03/13/2020

Inducing Optimal Attribute Representations for Conditional GANs

Conditional GANs are widely used in translating an image from one catego...
research
03/30/2019

COCO-GAN: Generation by Parts via Conditional Coordinating

Humans can only interact with part of the surrounding environment due to...
research
03/05/2022

Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance

Generative adversarial networks (GANs) have received an upsurging intere...

Please sign up or login with your details

Forgot password? Click here to reset