Sampling Using Neural Networks for colorizing the grayscale images

12/27/2018
by   Wonbong Jang, et al.
14

The main idea of this paper is to explore the possibilities of generating samples from the neural networks, mostly focusing on the colorization of the grey-scale images. I will compare the existing methods for colorization and explore the possibilities of using new generative modeling to the task of colorization. The contributions of this paper are to compare the existing structures with similar generating structures(Decoders) and to apply the novel structures including Conditional VAE(CVAE), Conditional Wasserstein GAN with Gradient Penalty(CWGAN-GP), CWGAN-GP with L1 reconstruction loss, Adversarial Generative Encoders(AGE) and Introspective VAE(IVAE). I trained these models using CIFAR-10 images. To measure the performance, I use Inception Score(IS) which measures how distinctive each image is and how diverse overall samples are as well as human eyes for CIFAR-10 images. It turns out that CVAE with L1 reconstruction loss and IVAE achieve the highest score in IS. CWGAN-GP with L1 tends to learn faster than CWGAN-GP, but IS does not increase from CWGAN-GP. CWGAN-GP tends to generate more diverse images than other models using reconstruction loss. Also, I figured out that the proper regularization plays a vital role in generative modeling.

READ FULL TEXT

page 11

page 14

page 17

page 20

research
05/20/2022

The effect of loss function on conditional generative adversarial networks

Conditional Generative Adversarial Network (cGAN) is a general purpose a...
research
12/07/2021

Generative Adversarial Networks for Data Generation in Structural Health Monitoring

Structural Health Monitoring (SHM) has been continuously benefiting from...
research
04/26/2022

Application of WGAN-GP in recommendation and Questioning the relevance of GAN-based approaches

Many neural-based recommender systems were proposed in recent years and ...
research
10/01/2021

Inverse airfoil design method for generating varieties of smooth airfoils using conditional WGAN-gp

Machine learning models are recently utilized for airfoil shape generati...
research
07/31/2018

Wasserstein GAN and Waveform Loss-based Acoustic Model Training for Multi-speaker Text-to-Speech Synthesis Systems Using a WaveNet Vocoder

Recent neural networks such as WaveNet and sampleRNN that learn directly...
research
09/22/2016

Neural Photo Editing with Introspective Adversarial Networks

The increasingly photorealistic sample quality of generative image model...

Please sign up or login with your details

Forgot password? Click here to reset