Patchwise Generative ConvNet: Training Energy-Based Models from a Single Natural Image for Internal Learning

05/19/2021
by   Zilong Zheng, et al.
0

Exploiting internal statistics of a single natural image has long been recognized as a significant research paradigm where the goal is to learn the internal distribution of patches within the image without relying on external training data. Different from prior works that model such a distribution implicitly with a top-down latent variable model (e.g., generator), this paper proposes to explicitly represent the statistical distribution within a single natural image by using an energy-based generative framework, where a pyramid of energy functions, each parameterized by a bottom-up deep neural network, is used to capture the distributions of patches at different resolutions. Meanwhile, a coarse-to-fine sequential training and sampling strategy is presented to train the model efficiently. Besides learning to generate random samples from white noise, the model can learn in parallel with a self-supervised task (e.g., recover the input image from its corrupted version), which can further improve the descriptive power of the learned model.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
12/01/2018

Internal Distribution Matching for Natural Image Retargeting

Good Visual Retargeting changes the global size and aspect ratio of a na...
research
12/03/2022

BlendGAN: Learning and Blending the Internal Distributions of Single Images by Spatial Image-Identity Conditioning

Training a generative model on a single image has drawn significant atte...
research
05/16/2021

ExSinGAN: Learning an Explainable Generative Model from a Single Image

Generating images from a single sample, as a newly developing branch of ...
research
11/07/2020

Blind Motion Deblurring through SinGAN Architecture

Blind motion deblurring involves reconstructing a sharp image from an ob...
research
03/24/2022

Bi-level Doubly Variational Learning for Energy-based Latent Variable Models

Energy-based latent variable models (EBLVMs) are more expressive than co...
research
12/05/2020

Deep Archimedean Copulas

A central problem in machine learning and statistics is to model joint d...
research
08/08/2020

From Rain Removal to Rain Generation

Single image deraining is an important yet challenging issue due to the ...

Please sign up or login with your details

Forgot password? Click here to reset