Variational image compression with a scale hyperprior

02/01/2018
by   Johannes Ballé, et al.
0

We describe an end-to-end trainable model for image compression based on variational autoencoders. The model incorporates a hyperprior to effectively capture spatial dependencies in the latent representation. This hyperprior relates to side information, a concept universal to virtually all modern image codecs, but largely unexplored in image compression using artificial neural networks (ANNs). Unlike existing autoencoder compression methods, our model trains a complex prior jointly with the underlying autoencoder. We demonstrate that this model leads to state-of-the-art image compression when measuring visual quality using the popular MS-SSIM index, and yields rate-distortion performance surpassing published ANN-based methods when evaluated using a more traditional metric based on squared error (PSNR). Furthermore, we provide a qualitative comparison of models trained for different distortion metrics.

READ FULL TEXT

page 3

page 9

research
12/11/2019

Variable Rate Deep Image Compression with Modulated Autoencoder

Variable rate is a requirement for flexible and adaptable image and vide...
research
11/05/2016

End-to-end Optimized Image Compression

We describe an image compression method, consisting of a nonlinear analy...
research
02/20/2019

An Autoencoder-based Learned Image Compressor: Description of Challenge Proposal by NCTU

We propose a lossy image compression system using the deep-learning auto...
research
08/14/2019

Video Compression With Rate-Distortion Autoencoders

In this paper we present a a deep generative model for lossy video compr...
research
05/18/2020

Deep Implicit Volume Compression

We describe a novel approach for compressing truncated signed distance f...
research
04/15/2019

Exact Rate-Distortion in Autoencoders via Echo Noise

Compression is at the heart of effective representation learning. Howeve...
research
10/12/2022

Attention-Based Generative Neural Image Compression on Solar Dynamics Observatory

NASA's Solar Dynamics Observatory (SDO) mission gathers 1.4 terabytes of...

Please sign up or login with your details

Forgot password? Click here to reset