Improved Techniques for Training Single-Image GANs

03/25/2020
by   Tobias Hinz, et al.
13

Recently there has been an interest in the potential of learning generative models from a single image, as opposed to from a large dataset. This task is of practical significance, as it means that generative models can be used in domains where collecting a large dataset is not feasible. However, training a model capable of generating realistic images from only a single sample is a difficult problem. In this work, we conduct a number of experiments to understand the challenges of training these methods and propose some best practices that we found allowed us to generate improved results over previous work in this space. One key piece is that unlike prior single image generation methods, we concurrently train several stages in a sequential multi-stage manner, allowing us to learn models with fewer stages of increasing image resolution. Compared to a recent state of the art baseline, our model is up to six times faster to train, has fewer parameters, and can better capture the global structure of images.

READ FULL TEXT

page 19

page 20

page 24

page 29

page 30

page 32

page 33

page 34

research
10/06/2021

Meta Internal Learning

Internal learning for single-image generation is a framework, where a ge...
research
02/09/2021

Diverse Single Image Generation with Controllable Global Structure through Self-Attention

Image generation from a single image using generative adversarial networ...
research
11/07/2019

This dataset does not exist: training models from generated images

Current generative networks are increasingly proficient in generating hi...
research
10/29/2021

SVBRDF Recovery From a Single Image With Highlights using a Pretrained Generative Adversarial Network

Spatially-varying bi-directional reflectance distribution functions (SVB...
research
03/29/2021

Drop the GAN: In Defense of Patches Nearest Neighbors as Single Image Generative Models

Single image generative models perform synthesis and manipulation tasks ...
research
12/03/2022

BlendGAN: Learning and Blending the Internal Distributions of Single Images by Spatial Image-Identity Conditioning

Training a generative model on a single image has drawn significant atte...
research
08/05/2023

Improved convergence of forward and inverse finite element models

Forward and inverse models are used throughout different engineering fie...

Please sign up or login with your details

Forgot password? Click here to reset