DeepAI
Log In Sign Up

Blur, Noise, and Compression Robust Generative Adversarial Networks

03/17/2020
by   Takuhiro Kaneko, et al.
7

Recently, generative adversarial networks (GANs), which learn data distributions through adversarial training, have gained special attention owing to their high image reproduction ability. However, one limitation of standard GANs is that they recreate training images faithfully despite image degradation characteristics such as blur, noise, and compression. To remedy this, we address the problem of blur, noise, and compression robust image generation. Our objective is to learn a non-degraded image generator directly from degraded images without prior knowledge of image degradation. The recently proposed noise robust GAN (NR-GAN) already provides a solution to the problem of noise degradation. Therefore, we first focus on blur and compression degradations. We propose blur robust GAN (BR-GAN) and compression robust GAN (CR-GAN), which learn a kernel generator and quality factor generator, respectively, with non-degraded image generators. Owing to the irreversible blur and compression characteristics, adjusting their strengths is non-trivial. Therefore, we incorporate switching architectures that can adapt the strengths in a data-driven manner. Based on BR-GAN, NR-GAN, and CR-GAN, we further propose blur, noise, and compression robust GAN (BNCR-GAN), which unifies these three models into a single model with additionally introduced adaptive consistency losses that suppress the uncertainty caused by the combination. We provide benchmark scores through large-scale comparative studies on CIFAR-10 and a generality analysis on FFHQ dataset.

READ FULL TEXT

page 4

page 5

page 10

page 11

page 12

page 15

page 16

page 21

11/27/2018

Label-Noise Robust Generative Adversarial Networks

Generative adversarial networks (GANs) are a framework that learns a gen...
08/24/2020

Fidelity-Controllable Extreme Image Compression with Generative Adversarial Networks

We propose a GAN-based image compression method working at extremely low...
06/15/2020

AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks

The compression of Generative Adversarial Networks (GANs) has lately dra...
09/07/2022

Supervised GAN Watermarking for Intellectual Property Protection

We propose a watermarking method for protecting the Intellectual Propert...
05/29/2019

Training Generative Adversarial Networks from Incomplete Observations using Factorised Discriminators

Generative adversarial networks (GANs) have shown great success in appli...
04/09/2018

Generative Adversarial Networks for Extreme Learned Image Compression

We propose a framework for extreme learned image compression based on Ge...
03/12/2018

Correction by Projection: Denoising Images with Generative Adversarial Networks

Generative adversarial networks (GANs) transform low-dimensional latent ...