StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows

08/06/2020
by   Rameen Abdal, et al.
68

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality of the output. Further, due to the entangled nature of the GAN latent space, performing edits along one attribute can easily result in unwanted changes along other attributes. In this paper, in the context of conditional exploration of entangled latent spaces, we investigate the two sub-problems of attribute-conditioned sampling and attribute-controlled editing. We present StyleFlow as a simple, effective, and robust solution to both the sub-problems by formulating conditional exploration as an instance of conditional continuous normalizing flows in the GAN latent space conditioned by attribute features. We evaluate our method using the face and the car latent space of StyleGAN, and demonstrate fine-grained disentangled edits along various attributes on both real photographs and StyleGAN generated images. For example, for faces, we vary camera pose, illumination variation, expression, facial hair, gender, and age. Finally, via extensive qualitative and quantitative comparisons, we demonstrate the superiority of StyleFlow to other concurrent works.

READ FULL TEXT

page 1

page 8

page 9

page 10

page 12

page 15

page 16

page 17

research
07/20/2022

Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space Exploration

Unconstrained Image generation with high realism is now possible using r...
research
10/05/2020

SMILE: Semantically-guided Multi-attribute Image and Layout Editing

Attribute image manipulation has been a very active topic since the intr...
research
09/22/2021

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

Great diversity and photorealism have been achieved by unconditional GAN...
research
01/07/2021

GAN-Control: Explicitly Controllable GANs

We present a framework for training GANs with explicit control over gene...
research
10/28/2021

Multi-Attribute Balanced Sampling for Disentangled GAN Controls

Various controls over the generated data can be extracted from the laten...
research
04/22/2021

Cross-Domain and Disentangled Face Manipulation with 3D Guidance

Face image manipulation via three-dimensional guidance has been widely a...
research
06/09/2021

CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flows

We introduce CaloFlow, a fast detector simulation framework based on nor...

Please sign up or login with your details

Forgot password? Click here to reset