PILC: Practical Image Lossless Compression with an End-to-end GPU Oriented Neural Framework

06/10/2022
by   Ning Kang, et al.
0

Generative model based image lossless compression algorithms have seen a great success in improving compression ratio. However, the throughput for most of them is less than 1 MB/s even with the most advanced AI accelerated chips, preventing them from most real-world applications, which often require 100 MB/s. In this paper, we propose PILC, an end-to-end image lossless compression framework that achieves 200 MB/s for both compression and decompression with a single NVIDIA Tesla V100 GPU, 10 times faster than the most efficient one before. To obtain this result, we first develop an AI codec that combines auto-regressive model and VQ-VAE which performs well in lightweight setting, then we design a low complexity entropy coder that works well with our codec. Experiments show that our framework compresses better than PNG by a margin of 30 compression forward to commercial use.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/18/2021

ANFIC: Image Compression Using Augmented Normalizing Flows

This paper introduces an end-to-end learned image compression system, te...
research
06/27/2023

LeCo: Lightweight Compression via Learning Serial Correlations

Lightweight data compression is a key technique that allows column store...
research
01/05/2022

Learning True Rate-Distortion-Optimization for End-To-End Image Compression

Even though rate-distortion optimization is a crucial part of traditiona...
research
05/16/2017

Real-Time Adaptive Image Compression

We present a machine learning-based approach to lossy image compression ...
research
04/01/2020

Understanding GPU-Based Lossy Compression for Extreme-Scale Cosmological Simulations

To help understand our universe better, researchers and scientists curre...
research
05/18/2020

Adapting JPEG XS gains and priorities to tasks and contents

Most current research in the domain of image compression focuses solely ...
research
07/13/2023

AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

As supercomputers advance towards exascale capabilities, computational i...

Please sign up or login with your details

Forgot password? Click here to reset