Semantic Photo Manipulation with a Generative Image Prior

05/15/2020
by   David Bau, et al.
21

Despite the recent success of GANs in synthesizing images conditioned on inputs such as a user sketch, text, or semantic labels, manipulating the high-level attributes of an existing natural photograph with GANs is challenging for two reasons. First, it is hard for GANs to precisely reproduce an input image. Second, after manipulation, the newly synthesized pixels often do not fit the original image. In this paper, we address these issues by adapting the image prior learned by GANs to image statistics of an individual image. Our method can accurately reconstruct the input image and synthesize new content, consistent with the appearance of the input image. We demonstrate our interactive system on several semantic image editing tasks, including synthesizing new objects consistent with background, removing unwanted objects, and changing the appearance of an object. Quantitative and qualitative comparisons against several existing methods demonstrate the effectiveness of our method.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 8

page 9

page 10

research
11/30/2017

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs

We present a new method for synthesizing high-resolution photo-realistic...
research
10/30/2020

MichiGAN: Multi-Input-Conditioned Hair Image Generation for Portrait Editing

Despite the recent success of face image generation with GANs, condition...
research
05/18/2023

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

Synthesizing visual content that meets users' needs often requires flexi...
research
08/01/2017

Generative Semantic Manipulation with Contrasting GAN

Generative Adversarial Networks (GANs) have recently achieved significan...
research
11/25/2022

Interactive Image Manipulation with Complex Text Instructions

Recently, text-guided image manipulation has received increasing attenti...
research
04/26/2022

Expanding the Latent Space of StyleGAN for Real Face Editing

Recently, a surge of face editing techniques have been proposed to emplo...
research
03/07/2021

Repurposing GANs for One-shot Semantic Part Segmentation

While GANs have shown success in realistic image generation, the idea of...

Please sign up or login with your details

Forgot password? Click here to reset