HiLLoC: Lossless Image Compression with Hierarchical Latent Variable Models

12/20/2019
by   James Townsend, et al.
0

We make the following striking observation: fully convolutional VAE models trained on 32x32 ImageNet can generalize well, not just to 64x64 but also to far larger photographs, with no changes to the model. We use this property, applying fully convolutional models to lossless compression, demonstrating a method to scale the VAE-based 'Bits-Back with ANS' algorithm for lossless compression to large color photographs, and achieving state of the art for compression of full size ImageNet images. We release Craystack, an open source library for convenient prototyping of lossless compression using probabilistic models, along with full implementations of all of our compression results.

READ FULL TEXT
research
04/21/2021

Lossless Compression with Latent Variable Models

We develop a simple and elegant method for lossless compression using la...
research
01/15/2019

Practical Lossless Compression with Latent Variables using Bits Back Coding

Deep latent variable models have seen recent success in many data domain...
research
05/16/2019

Bit-Swap: Recursive Bits-Back Coding for Lossless Compression with Hierarchical Latent Variables

The bits-back argument suggests that latent variable models can be turne...
research
06/07/2020

Improving Inference for Neural Image Compression

We consider the problem of lossy image compression with deep latent vari...
research
03/18/2021

Lossless compression with state space models using bits back coding

We generalize the 'bits back with ANS' method to time-series models with...
research
05/17/2018

Fully Convolutional Model for Variable Bit Length and Lossy High Density Compression of Mammograms

Early works on medical image compression date to the 1980's with the imp...
research
04/29/2016

Towards Conceptual Compression

We introduce a simple recurrent variational auto-encoder architecture th...

Please sign up or login with your details

Forgot password? Click here to reset