Spatial PixelCNN: Generating Images from Patches

12/03/2017
by   Nader Akoury, et al.
0

In this paper we propose Spatial PixelCNN, a conditional autoregressive model that generates images from small patches. By conditioning on a grid of pixel coordinates and global features extracted from a Variational Autoencoder (VAE), we are able to train on patches of images, and reproduce the full-sized image. We show that it not only allows for generating high quality samples at the same resolution as the underlying dataset, but is also capable of upscaling images to arbitrary resolutions (tested at resolutions up to 50×) on the MNIST dataset. Compared to a PixelCNN++ baseline, Spatial PixelCNN quantitatively and qualitatively achieves similar performance on the MNIST dataset.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 7

page 11

page 12

research
04/14/2022

Any-resolution Training for High-resolution Image Synthesis

Generative models operate at fixed resolution, even though natural image...
research
12/03/2021

Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation

The integration of Vector Quantised Variational AutoEncoder (VQ-VAE) wit...
research
01/28/2022

Any Variational Autoencoder Can Do Arbitrary Conditioning

Arbitrary conditioning is an important problem in unsupervised learning,...
research
02/07/2022

Inference of captions from histopathological patches

Computational histopathology has made significant strides in the past fe...
research
04/06/2018

Expressive Speech Synthesis via Modeling Expressions with Variational Autoencoder

Recent advances in neural autoregressive models have improve the perform...
research
01/29/2022

Scale-arbitrary Invertible Image Downscaling

Downscaling is indispensable when distributing high-resolution (HR) imag...
research
03/06/2019

Hierarchical Autoregressive Image Models with Auxiliary Decoders

Autoregressive generative models of images tend to be biased towards cap...

Please sign up or login with your details

Forgot password? Click here to reset