QC-StyleGAN – Quality Controllable Image Generation and Manipulation

12/02/2022
by   Dat Viet Thanh Nguyen, et al.
0

The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs, making them unfit for in-the-wild low-quality (LQ) images, which are common inputs for manipulation. In this work, we bridge this gap by proposing a novel GAN structure that allows for generating images with controllable quality. The network can synthesize various image degradation and restore the sharp image via a quality control code. Our proposed QC-StyleGAN can directly edit LQ images without altering their quality by applying GAN inversion and manipulation techniques. It also provides for free an image restoration solution that can handle various degradations, including noise, blur, compression artifacts, and their mixtures. Finally, we demonstrate numerous other applications such as image degradation synthesis, transfer, and interpolation. The code is available at https://github.com/VinAIResearch/QC-StyleGAN.

READ FULL TEXT

page 26

page 27

page 29

page 30

page 31

page 33

page 34

page 35

research
08/24/2020

Fidelity-Controllable Extreme Image Compression with Generative Adversarial Networks

We propose a GAN-based image compression method working at extremely low...
research
08/24/2022

3D-FM GAN: Towards 3D-Controllable Face Manipulation

3D-controllable portrait synthesis has significantly advanced, thanks to...
research
03/30/2020

Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation

Learning a good image prior is a long-term goal for image restoration an...
research
02/07/2023

High-Resolution GAN Inversion for Degraded Images in Large Diverse Datasets

The last decades are marked by massive and diverse image data, which sho...
research
02/05/2023

Divide and Compose with Score Based Generative Models

While score based generative models, or diffusion models, have found suc...
research
05/22/2023

Interactive Data Synthesis for Systematic Vision Adaptation via LLMs-AIGCs Collaboration

Recent text-to-image generation models have shown promising results in g...
research
03/22/2023

VecFontSDF: Learning to Reconstruct and Synthesize High-quality Vector Fonts via Signed Distance Functions

Font design is of vital importance in the digital content design and mod...

Please sign up or login with your details

Forgot password? Click here to reset