Editing in Style: Uncovering the Local Semantics of GANs

04/29/2020
by   Edo Collins, et al.
0

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local, semantically-aware edits to a target output image. This is accomplished by borrowing elements from a source image, also a GAN output, via a novel manipulation of style vectors. Our method requires neither supervision from an external model, nor involves complex spatial morphing operations. Instead, it relies on the emergent disentanglement of semantic objects that is learned by StyleGAN during its training. Semantic editing is demonstrated on GANs producing human faces, indoor scenes, cats, and cars. We measure the locality and photorealism of the edits produced by our method, and find that it accomplishes both.

READ FULL TEXT

page 12

page 13

page 14

page 15

page 18

page 19

page 20

page 21

research
01/20/2023

Spatial Steerability of GANs via Self-Supervision from Discriminator

Generative models make huge progress to the photorealistic image synthes...
research
05/18/2021

Decorating Your Own Bedroom: Locally Controlling Image Generation with Generative Adversarial Networks

Generative Adversarial Networks (GANs) have made great success in synthe...
research
11/22/2022

S^2-Flow: Joint Semantic and Style Editing of Facial Images

The high-quality images yielded by generative adversarial networks (GANs...
research
03/26/2023

BlobGAN-3D: A Spatially-Disentangled 3D-Aware Generative Model for Indoor Scenes

3D-aware image synthesis has attracted increasing interest as it models ...
research
05/24/2019

Mask-Guided Portrait Editing with Conditional GANs

Portrait editing is a popular subject in photo manipulation. The Generat...
research
02/03/2023

Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field

Recently 3D-aware GAN methods with neural radiance field have developed ...
research
04/06/2023

Synthesizing Anyone, Anywhere, in Any Pose

We address the task of in-the-wild human figure synthesis, where the pri...

Please sign up or login with your details

Forgot password? Click here to reset