S^2-Flow: Joint Semantic and Style Editing of Facial Images

11/22/2022
by   Krishnakant Singh, et al.
0

The high-quality images yielded by generative adversarial networks (GANs) have motivated investigations into their application for image editing. However, GANs are often limited in the control they provide for performing specific edits. One of the principal challenges is the entangled latent space of GANs, which is not directly suitable for performing independent and detailed edits. Recent editing methods allow for either controlled style edits or controlled semantic edits. In addition, methods that use semantic masks to edit images have difficulty preserving the identity and are unable to perform controlled style edits. We propose a method to disentangle a GAN's latent space into semantic and style spaces, enabling controlled semantic and style edits for face images independently within the same framework. To achieve this, we design an encoder-decoder based network architecture (S^2-Flow), which incorporates two proposed inductive biases. We show the suitability of S^2-Flow quantitatively and qualitatively by performing various semantic and style edits.

READ FULL TEXT

page 10

page 20

page 21

page 22

page 23

page 24

page 25

page 26

research
11/04/2021

EditGAN: High-Precision Semantic Image Editing

Generative adversarial networks (GANs) have recently found applications ...
research
11/19/2020

Style Intervention: How to Achieve Spatial Disentanglement with Style-based Generators?

Generative Adversarial Networks (GANs) with style-based generators (e.g....
research
08/26/2022

User-Controllable Latent Transformer for StyleGAN Image Layout Editing

Latent space exploration is a technique that discovers interpretable lat...
research
08/16/2019

TunaGAN: Interpretable GAN for Smart Editing

In this paper, we introduce a tunable generative adversary network (Tuna...
research
11/30/2018

The GAN that Warped: Semantic Attribute Editing with Unpaired Data

Deep neural networks have recently been used to edit images with great s...
research
04/29/2020

Editing in Style: Uncovering the Local Semantics of GANs

While the quality of GAN image synthesis has improved tremendously in re...
research
11/26/2022

Deep Curvilinear Editing: Commutative and Nonlinear Image Manipulation for Pretrained Deep Generative Model

Semantic editing of images is the fundamental goal of computer vision. A...

Please sign up or login with your details

Forgot password? Click here to reset