Deep Single Image Manipulation

07/02/2020
by   Yael Vinker, et al.
0

Image manipulation has attracted much research over the years due to the popularity and commercial importance of the task. In recent years, deep neural network methods have been proposed for many image manipulation tasks. A major issue with deep methods is the need to train on large amounts of data from the same distribution as the target image, whereas collecting datasets encompassing the entire long-tail of images is impossible. In this paper, we demonstrate that simply training a conditional adversarial generator on the single target image is sufficient for performing complex image manipulations. We find that the key for enabling single image training is extensive augmentation of the input image and provide a novel augmentation method. Our network learns to map between a primitive representation of the image (e.g. edges) to the image itself. At manipulation time, our generator allows for making general image changes by modifying the primitive input representation and mapping it through the network. We extensively evaluate our method and find that it provides remarkable performance.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

page 8

research
09/13/2021

Image Shape Manipulation from a Single Augmented Training Sample

In this paper, we present DeepSIM, a generative model for conditional im...
research
04/07/2020

Training End-to-end Single Image Generators without GANs

We present AugurOne, a novel approach for training single image generati...
research
11/21/2022

SinFusion: Training Diffusion Models on a Single Image or Video

Diffusion models exhibited tremendous progress in image and video genera...
research
11/07/2020

DeepCFL: Deep Contextual Features Learning from a Single Image

Recently, there is a vast interest in developing image feature learning ...
research
06/25/2021

Single Image Texture Translation for Data Augmentation

Recent advances in image synthesis enables one to translate images by le...
research
03/07/2016

From A to Z: Supervised Transfer of Style and Content Using Deep Neural Network Generators

We propose a new neural network architecture for solving single-image an...
research
09/26/2021

DAMix: Density-Aware Data Augmentation for Unsupervised Domain Adaptation on Single Image Dehazing

Learning-based methods have achieved great success on single image dehaz...

Please sign up or login with your details

Forgot password? Click here to reset