Variable-Bitrate Neural Compression via Bayesian Arithmetic Coding

by   Yibo Yang, et al.

Deep Bayesian latent variable models have enabled new approaches to both model and data compression. Here, we propose a new algorithm for compressing latent representations in deep probabilistic models, such as variational autoencoders, in post-processing. The approach thus separates model design and training from the compression task. Our algorithm generalizes arithmetic coding to the continuous domain, using adaptive discretization accuracy that exploits estimates of posterior uncertainty. A consequence of the "plug and play" nature of our approach is that various rate-distortion trade-offs can be achieved with a single trained model, eliminating the need to train multiple models for different bit rates. Our experimental results demonstrate the importance of taking into account posterior uncertainties, and show that image compression with the proposed algorithm outperforms JPEG over a wide range of bit rates using only a single machine learning model. Further experiments on Bayesian neural word embeddings demonstrate the versatility of the proposed method.


page 13

page 14

page 15

page 17

page 19

page 20

page 21

page 22


Rate Distortion Characteristic Modeling for Neural Image Compression

End-to-end optimization capability offers neural image compression (NIC)...

Bit-Swap: Recursive Bits-Back Coding for Lossless Compression with Hierarchical Latent Variables

The bits-back argument suggests that latent variable models can be turne...

Latent Discretization for Continuous-time Sequence Compression

Neural compression offers a domain-agnostic approach to creating codecs ...

Compression with Bayesian Implicit Neural Representations

Many common types of data can be represented as functions that map coord...

Differentiable bit-rate estimation for neural-based video codec enhancement

Neural networks (NN) can improve standard video compression by pre- and ...

Learning Representations by Maximizing Compression

We give an algorithm that learns a representation of data through compre...

Substitutional Neural Image Compression

We describe Substitutional Neural Image Compression (SNIC), a general ap...

Code Repositories


Code for paper "Variable-Bitrate Neural Compression via Bayesian Arithmetic Coding"

view repo


Code for paper "Variable-Bitrate Neural Compression via Bayesian Arithmetic Coding"

view repo

Please sign up or login with your details

Forgot password? Click here to reset