Analyzing and Improving the Image Quality of StyleGAN

12/03/2019
by   Tero Karras, et al.
37

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model architecture and training methods to address them. In particular, we redesign generator normalization, revisit progressive growing, and regularize the generator to encourage good conditioning in the mapping from latent vectors to images. In addition to improving image quality, this path length regularizer yields the additional benefit that the generator becomes significantly easier to invert. This makes it possible to reliably detect if an image is generated by a particular network. We furthermore visualize how well the generator utilizes its output resolution, and identify a capacity problem, motivating us to train larger models for additional quality improvements. Overall, our improved model redefines the state of the art in unconditional image modeling, both in terms of existing distribution quality metrics as well as perceived image quality.

READ FULL TEXT

page 4

page 8

page 11

page 12

page 13

page 14

page 15

page 19

research
12/06/2021

Tunable Image Quality Control of 3-D Ultrasound using Switchable CycleGAN

In contrast to 2-D ultrasound (US) for uniaxial plane imaging, a 3-D US ...
research
10/27/2017

Progressive Growing of GANs for Improved Quality, Stability, and Variation

We describe a new training methodology for generative adversarial networ...
research
02/01/2022

StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

Computer graphics has experienced a recent surge of data-centric approac...
research
06/13/2021

Styleformer: Transformer based Generative Adversarial Networks with Style Vector

We propose Styleformer, which is a style-based generator for GAN archite...
research
09/04/2021

Fast Image-Anomaly Mitigation for Autonomous Mobile Robots

Camera anomalies like rain or dust can severelydegrade image quality and...
research
06/21/2022

EpiGRAF: Rethinking training of 3D GANs

A very recent trend in generative modeling is building 3D-aware generato...
research
08/07/2022

Hierarchical Semantic Regularization of Latent Spaces in StyleGANs

Progress in GANs has enabled the generation of high-resolution photoreal...

Please sign up or login with your details

Forgot password? Click here to reset