GAN-based Image Compression with Improved RDO Process

06/18/2023
by   Fanxin Xia, et al.
0

GAN-based image compression schemes have shown remarkable progress lately due to their high perceptual quality at low bit rates. However, there are two main issues, including 1) the reconstructed image perceptual degeneration in color, texture, and structure as well as 2) the inaccurate entropy model. In this paper, we present a novel GAN-based image compression approach with improved rate-distortion optimization (RDO) process. To achieve this, we utilize the DISTS and MS-SSIM metrics to measure perceptual degeneration in color, texture, and structure. Besides, we absorb the discretized gaussian-laplacian-logistic mixture model (GLLMM) for entropy modeling to improve the accuracy in estimating the probability distributions of the latent representation. During the evaluation process, instead of evaluating the perceptual quality of the reconstructed image via IQA metrics, we directly conduct the Mean Opinion Score (MOS) experiment among different codecs, which fully reflects the actual perceptual results of humans. Experimental results demonstrate that the proposed method outperforms the existing GAN-based methods and the state-of-the-art hybrid codec (i.e., VVC).

READ FULL TEXT

page 2

page 8

research
02/25/2023

JND-Based Perceptual Optimization For Learned Image Compression

Recently, learned image compression schemes have achieved remarkable imp...
research
07/28/2021

Subjective evaluation of traditional and learning-based image coding methods

We conduct a subjective experiment to compare the performance of traditi...
research
02/13/2018

Joint Demosaicing and Denoising with Perceptual Optimization on a Generative Adversarial Network

Image demosaicing - one of the most important early stages in digital ca...
research
08/24/2020

Fidelity-Controllable Extreme Image Compression with Generative Adversarial Networks

We propose a GAN-based image compression method working at extremely low...
research
09/14/2022

Lossy Image Compression with Conditional Diffusion Models

Denoising diffusion models have recently marked a milestone in high-qual...
research
05/26/2022

Measuring Perceptual Color Differences of Smartphone Photography

Measuring perceptual color differences (CDs) is of great importance in m...
research
07/02/2020

PerceptionGAN: Real-world Image Construction from Provided Text through Perceptual Understanding

Generating an image from a provided descriptive text is quite a challeng...

Please sign up or login with your details

Forgot password? Click here to reset