iFlow: Numerically Invertible Flows for Efficient Lossless Compression via a Uniform Coder

11/01/2021
by   Shifeng Zhang, et al.
0

It was estimated that the world produced 59 ZB (5.9 × 10^13 GB) of data in 2020, resulting in the enormous costs of both data storage and transmission. Fortunately, recent advances in deep generative models have spearheaded a new class of so-called "neural compression" algorithms, which significantly outperform traditional codecs in terms of compression ratio. Unfortunately, the application of neural compression garners little commercial interest due to its limited bandwidth; therefore, developing highly efficient frameworks is of critical practical importance. In this paper, we discuss lossless compression using normalizing flows which have demonstrated a great capacity for achieving high compression ratios. As such, we introduce iFlow, a new method for achieving efficient lossless compression. We first propose Modular Scale Transform (MST) and a novel family of numerically invertible flow transformations based on MST. Then we introduce the Uniform Base Conversion System (UBCS), a fast uniform-distribution codec incorporated into iFlow, enabling efficient compression. iFlow achieves state-of-the-art compression ratios and is 5× quicker than other high-performance schemes. Furthermore, the techniques presented in this paper can be used to accelerate coding time for a broad class of flow-based algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2021

iVPF: Numerical Invertible Volume Preserving Flow for Efficient Lossless Compression

It is nontrivial to store rapidly growing big data nowadays, which deman...
research
11/23/2021

Lossless Compression with Probabilistic Circuits

Despite extensive progress on image generation, deep generative models a...
research
05/21/2019

Compression with Flows via Local Bits-Back Coding

Likelihood-based generative models are the backbones of lossless compres...
research
06/19/2023

Parallel Data Compression Techniques

With endless amounts of data and very limited bandwidth, fast data compr...
research
06/17/2022

Fast Lossless Neural Compression with Integer-Only Discrete Flows

By applying entropy codecs with learned data distributions, neural compr...
research
02/20/2020

Storage Space Allocation Strategy for Digital Data with Message Importance

This paper mainly focuses on the problem of lossy compression storage fr...
research
11/16/2019

IDEALEM: Statistical Similarity Based Data Reduction

Many applications such as scientific simulation, sensing, and power grid...

Please sign up or login with your details

Forgot password? Click here to reset