Fidelity-Controllable Extreme Image Compression with Generative Adversarial Networks

08/24/2020
by   Shoma Iwai, et al.
10

We propose a GAN-based image compression method working at extremely low bitrates below 0.1bpp. Most existing learned image compression methods suffer from blur at extremely low bitrates. Although GAN can help to reconstruct sharp images, there are two drawbacks. First, GAN makes training unstable. Second, the reconstructions often contain unpleasing noise or artifacts. To address both of the drawbacks, our method adopts two-stage training and network interpolation. The two-stage training is effective to stabilize the training. Moreover, the network interpolation utilizes the models in both stages and reduces undesirable noise and artifacts, while maintaining important edges. Hence, we can control the trade-off between perceptual quality and fidelity without re-training models. The experimental results show that our model can reconstruct high quality images. Furthermore, our user study confirms that our reconstructions are preferable to state-of-the-art GAN-based image compression model. The code will be available.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

research
12/02/2022

QC-StyleGAN – Quality Controllable Image Generation and Manipulation

The introduction of high-quality image generation models, particularly t...
research
03/17/2020

Blur, Noise, and Compression Robust Generative Adversarial Networks

Recently, generative adversarial networks (GANs), which learn data distr...
research
04/26/2023

Multi-Modality Deep Network for Extreme Learned Image Compression

Image-based single-modality compression learning approaches have demonst...
research
06/17/2020

High-Fidelity Generative Image Compression

We extensively study how to combine Generative Adversarial Networks and ...
research
06/18/2023

GAN-based Image Compression with Improved RDO Process

GAN-based image compression schemes have shown remarkable progress latel...
research
04/22/2022

Speaking-Rate-Controllable HiFi-GAN Using Feature Interpolation

This paper presents a speaking-rate-controllable HiFi-GAN neural vocoder...
research
06/14/2020

CompressNet: Generative Compression at Extremely Low Bitrates

Compressing images at extremely low bitrates (< 0.1 bpp) has always been...

Please sign up or login with your details

Forgot password? Click here to reset