Variable Rate Deep Image Compression with Modulated Autoencoder

12/11/2019
by   Fei Yang, et al.
0

Variable rate is a requirement for flexible and adaptable image and video compression. However, deep image compression methods are optimized for a single fixed rate-distortion tradeoff. While this can be addressed by training multiple models for different tradeoffs, the memory requirements increase proportionally to the number of models. Scaling the bottleneck representation of a shared autoencoder can provide variable rate compression with a single shared autoencoder. However, the R-D performance using this simple mechanism degrades in low bitrates, and also shrinks the effective range of bit rates. Addressing these limitations, we formulate the problem of variable rate-distortion optimization for deep image compression, and propose modulated autoencoders (MAEs), where the representations of a shared autoencoder are adapted to the specific rate-distortion tradeoff via a modulation network. Jointly training this modulated autoencoder and modulation network provides an effective way to navigate the R-D operational curve. Our experiments show that the proposed method can achieve almost the same R-D performance of independent models with significantly fewer parameters.

READ FULL TEXT

page 1

page 3

page 4

research
03/29/2021

Slimmable Compressive Autoencoders for Practical Neural Image Compression

Neural image compression leverages deep neural networks to outperform tr...
research
06/24/2021

Rate Distortion Characteristic Modeling for Neural Image Compression

End-to-end optimization capability offers neural image compression (NIC)...
research
02/01/2018

Variational image compression with a scale hyperprior

We describe an end-to-end trainable model for image compression based on...
research
05/13/2022

Slimmable Video Codec

Neural video compression has emerged as a novel paradigm combining train...
research
05/08/2020

Lossy Compression with Distortion Constrained Optimization

When training end-to-end learned models for lossy compression, one has t...
research
05/18/2023

Transformer-based Variable-rate Image Compression with Region-of-interest Control

This paper proposes a transformer-based learned image compression system...
research
08/21/2021

Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transform

We propose a versatile deep image compression network based on Spatial F...

Please sign up or login with your details

Forgot password? Click here to reset