Internal Distribution Matching for Natural Image Retargeting

12/01/2018
by   Assaf Shocher, et al.
0

Good Visual Retargeting changes the global size and aspect ratio of a natural image, while preserving the size and aspect ratio of all its local elements. We propose formulating this principle by requiring that the distribution of patches in the input matches the distribution of patches in the output. We introduce a Deep-Learning approach for retargeting, based on an "Internal GAN" (InGAN). InGAN is an image-specific GAN. It incorporates the Internal statistics of a single natural image in a GAN. It is trained on a single input image and learns the distribution of its patches. It is then able to synthesize natural looking target images composed from the input image patch-distribution. InGAN is totally unsupervised, and requires no additional data other than the input image itself. Moreover, once trained on the input image, it can generate target images of any specified size or aspect ratio in real-time.

READ FULL TEXT

page 2

page 5

page 6

page 7

page 8

research
05/02/2019

SinGAN: Learning a Generative Model from a Single Natural Image

We introduce SinGAN, an unconditional generative model that can be learn...
research
05/19/2021

Patchwise Generative ConvNet: Training Energy-Based Models from a Single Natural Image for Internal Learning

Exploiting internal statistics of a single natural image has long been r...
research
09/14/2019

Blind Super-Resolution Kernel Estimation using an Internal-GAN

Super resolution (SR) methods typically assume that the low-resolution (...
research
07/31/2021

Manifold-Inspired Single Image Interpolation

Manifold models consider natural-image patches to be on a low-dimensiona...
research
02/18/2021

DSRN: an Efficient Deep Network for Image Relighting

Custom and natural lighting conditions can be emulated in images of the ...
research
06/26/2022

Image Aesthetics Assessment Using Graph Attention Network

Aspect ratio and spatial layout are two of the principal factors determi...
research
11/02/2022

The Lottery Ticket Hypothesis for Vision Transformers

The conventional lottery ticket hypothesis (LTH) claims that there exist...

Please sign up or login with your details

Forgot password? Click here to reset