Dual-layer Image Compression via Adaptive Downsampling and Spatially Varying Upconversion

02/13/2023
by   Xi Zhang, et al.
0

Ultra high resolution (UHR) images are almost always downsampled to fit small displays of mobile end devices and upsampled to its original resolution when exhibited on very high-resolution displays. This observation motivates us on jointly optimizing operation pairs of downsampling and upsampling that are spatially adaptive to image contents for maximal rate-distortion performance. In this paper, we propose an adaptive downsampled dual-layer (ADDL) image compression system. In the ADDL compression system, an image is reduced in resolution by learned content-adaptive downsampling kernels and compressed to form a coded base layer. For decompression the base layer is decoded and upconverted to the original resolution using a deep upsampling neural network, aided by the prior knowledge of the learned adaptive downsampling kernels. We restrict the downsampling kernels to the form of Gabor filters in order to reduce the complexity of filter optimization and also reduce the amount of side information needed by the decoder for adaptive upsampling. Extensive experiments demonstrate that the proposed ADDL compression approach of jointly optimized, spatially adaptive downsampling and upconversion outperforms the state of the art image compression methods.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 9

research
07/28/2022

Content-oriented learned image compression

In recent years, with the development of deep neural networks, end-to-en...
research
04/05/2023

Hierarchical B-frame Video Coding Using Two-Layer CANF without Motion Coding

Typical video compression systems consist of two main modules: motion co...
research
12/11/2019

CARP: Compression through Adaptive Recursive Partitioning for Multi-dimensional Images

Fast and effective image compression for multi-dimensional images has be...
research
12/20/2022

Content Adaptive Latents and Decoder for Neural Image Compression

In recent years, neural image compression (NIC) algorithms have shown po...
research
03/29/2021

Attention-guided Image Compression by Deep Reconstruction of Compressive Sensed Saliency Skeleton

We propose a deep learning system for attention-guided dual-layer image ...
research
07/22/2019

Learned Image Downscaling for Upscaling using Content Adaptive Resampler

Deep convolutional neural network based image super-resolution (SR) mode...
research
04/06/2020

Rethinking Spatially-Adaptive Normalization

Spatially-adaptive normalization is remarkably successful recently in co...

Please sign up or login with your details

Forgot password? Click here to reset