Generating natural images with direct Patch Distributions Matching

03/22/2022
by   Ariel Elnekave, et al.
0

Many traditional computer vision algorithms generate realistic images by requiring that each patch in the generated image be similar to a patch in a training image and vice versa. Recently, this classical approach has been replaced by adversarial training with a patch discriminator. The adversarial approach avoids the computational burden of finding nearest neighbors of patches but often requires very long training times and may fail to match the distribution of patches. In this paper we leverage the recently developed Sliced Wasserstein Distance and develop an algorithm that explicitly and efficiently minimizes the distance between patch distributions in two images. Our method is conceptually simple, requires no training and can be implemented in a few lines of codes. On a number of image generation tasks we show that our results are often superior to single-image-GANs, require no training, and can generate high quality images in a few seconds. Our implementation is available at https://github.com/ariel415el/GPDM

READ FULL TEXT

page 9

page 10

page 18

page 19

page 20

page 21

page 22

page 23

research
03/29/2021

Drop the GAN: In Defense of Patches Nearest Neighbors as Single Image Generative Models

Single image generative models perform synthesis and manipulation tasks ...
research
03/14/2020

Certified Defenses for Adversarial Patches

Adversarial patch attacks are among one of the most practical threat mod...
research
05/11/2020

A Survey on Patch-based Synthesis: GPU Implementation and Optimization

This thesis surveys the research in patch-based synthesis and algorithms...
research
10/12/2020

On the Minimal Recognizable Image Patch

In contrast to human vision, common recognition algorithms often fail on...
research
10/08/2020

Single-Image Camera Response Function Using Prediction Consistency and Gradual Refinement

A few methods have been proposed to estimate the CRF from a single image...
research
09/23/2016

Example-Based Image Synthesis via Randomized Patch-Matching

Image and texture synthesis is a challenging task that has long been dra...
research
09/27/2021

Wasserstein Patch Prior for Image Superresolution

In this paper, we introduce a Wasserstein patch prior for superresolutio...

Please sign up or login with your details

Forgot password? Click here to reset