End-to-End Learned Block-Based Image Compression with Block-Level Masked Convolutions and Asymptotic Closed Loop Training

03/22/2022
by   Fatih Kamisli, et al.
0

Learned image compression research has achieved state-of-the-art compression performance with auto-encoder based neural network architectures, where the image is mapped via convolutional neural networks (CNN) into a latent representation that is quantized and processed again with CNN to obtain the reconstructed image. CNN operate on entire input images. On the other hand, traditional state-of-the-art image and video compression methods process images with a block-by-block processing approach for various reasons. Very recently, work on learned image compression with block based approaches have also appeared, which use the auto-encoder architecture on large blocks of the input image and introduce additional neural networks that perform intra/spatial prediction and deblocking/post-processing functions. This paper explores an alternative learned block-based image compression approach in which neither an explicit intra prediction neural network nor an explicit deblocking neural network is used. A single auto-encoder neural network with block-level masked convolutions is used and the block size is much smaller (8x8). By using block-level masked convolutions, each block is processed using reconstructed neighboring left and upper blocks both at the encoder and decoder. Hence, the mutual information between adjacent blocks is exploited during compression and each block is reconstructed using neighboring blocks, resolving the need for explicit intra prediction and deblocking neural networks. Since the explored system is a closed loop system, a special optimization procedure, the asymptotic closed loop design, is used with standard stochastic gradient descent based training. The experimental results indicate competitive image compression performance.

READ FULL TEXT
research
05/28/2018

Block-optimized Variable Bit Rate Neural Image Compression

In this work, we propose an end-to-end block-based auto-encoder system f...
research
12/17/2020

Learned Block-based Hybrid Image Compression

Learned image compression based on neural networks have made huge progre...
research
04/01/2019

Layered Image Compression using Scalable Auto-encoder

This paper presents a novel convolutional neural network (CNN) based ima...
research
12/31/2020

Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blocks

Recently deep learning-based image compression has shown the potential t...
research
07/17/2018

Context-adaptive neural network based prediction for image compression

This paper describes a set of neural network architectures, called Predi...
research
08/17/2018

Convolutional Neural Networks based Intra Prediction for HEVC

Traditional intra prediction methods for HEVC rely on using the nearest ...
research
07/28/2020

On the Impact of Lossy Image and Video Compression on the Performance of Deep Convolutional Neural Network Architectures

Recent advances in generalized image understanding have seen a surge in ...

Please sign up or login with your details

Forgot password? Click here to reset