SinGAN: Learning a Generative Model from a Single Natural Image

05/02/2019
by   Tamar Rott Shaham, et al.
0

We introduce SinGAN, an unconditional generative model that can be learned from a single natural image. Our model is trained to capture the internal distribution of patches within the image, and is then able to generate high quality, diverse samples that carry the same visual content as the image. SinGAN contains a pyramid of fully convolutional GANs, each responsible for learning the patch distribution at a different scale of the image. This allows generating new samples of arbitrary size and aspect ratio, that have significant variability, yet maintain both the global structure and the fine textures of the training image. In contrast to previous single image GAN schemes, our approach is not limited to texture images, and is not conditional (i.e. it generates samples from noise). User studies confirm that the generated samples are commonly confused to be real images. We illustrate the utility of SinGAN in a wide range of image manipulation tasks.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

page 8

research
12/03/2022

BlendGAN: Learning and Blending the Internal Distributions of Single Images by Spatial Image-Identity Conditioning

Training a generative model on a single image has drawn significant atte...
research
12/01/2018

Internal Distribution Matching for Natural Image Retargeting

Good Visual Retargeting changes the global size and aspect ratio of a na...
research
05/16/2021

ExSinGAN: Learning an Explainable Generative Model from a Single Image

Generating images from a single sample, as a newly developing branch of ...
research
03/23/2021

SETGAN: Scale and Energy Trade-off GANs for Image Applications on Mobile Platforms

We consider the task of photo-realistic unconditional image generation (...
research
03/03/2022

PetsGAN: Rethinking Priors for Single Image Generation

Single image generation (SIG), described as generating diverse samples t...
research
06/18/2015

Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks

In this paper we introduce a generative parametric model capable of prod...
research
11/22/2022

SinDiffusion: Learning a Diffusion Model from a Single Natural Image

We present SinDiffusion, leveraging denoising diffusion models to captur...

Please sign up or login with your details

Forgot password? Click here to reset