An Acceleration Framework for High Resolution Image Synthesis

by   Jinlin Liu, et al.

Synthesis of high resolution images using Generative Adversarial Networks (GANs) is challenging, which usually requires numbers of high-end graphic cards with large memory and long time of training. In this paper, we propose a two-stage framework to accelerate the training process of synthesizing high resolution images. High resolution images are first transformed to small codes via the trained encoder and decoder networks. The code in latent space is times smaller than the original high resolution images. Then, we train a code generation network to learn the distribution of the latent codes. In this way, the generator only learns to generate small latent codes instead of large images. Finally, we decode the generated latent codes to image space via the decoder networks so as to output the synthesized high resolution images. Experimental results show that the proposed method accelerates the training process significantly and increases the quality of the generated samples. The proposed acceleration framework makes it possible to generate high resolution images using less training time with limited hardware resource. After using the proposed acceleration method, it takes only 3 days to train a 1024 *1024 image generator on Celeba-HQ dataset using just one NVIDIA P100 graphic card.


page 1

page 2

page 4

page 6

page 7

page 8


Generative Adversarial Networks with Decoder-Encoder Output Noise

In recent years, research on image generation methods has been developin...

IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis

We present a novel introspective variational autoencoder (IntroVAE) mode...

Aligning Latent and Image Spaces to Connect the Unconnectable

In this work, we develop a method to generate infinite high-resolution i...

Style-Guided Inference of Transformer for High-resolution Image Synthesis

Transformer is eminently suitable for auto-regressive image synthesis wh...

Binary Latent Diffusion

In this paper, we show that a binary latent space can be explored for co...

Raw Bayer Pattern Image Synthesis with Conditional GAN

In this paper, we propose a method to generate Bayer pattern images by G...

Variational Saccading: Efficient Inference for Large Resolution Images

Image classification with deep neural networks is typically restricted t...

Please sign up or login with your details

Forgot password? Click here to reset