Lossless preprocessing of floating point data to enhance compression

08/07/2023
by   Francesco Taurone, et al.
0

Data compression algorithms typically rely on identifying repeated sequences of symbols from the original data to provide a compact representation of the same information, while maintaining the ability to recover the original data from the compressed sequence. Using data transformations prior to the compression process has the potential to enhance the compression capabilities, being lossless as long as the transformation is invertible. Floating point data presents unique challenges to generate invertible transformations with high compression potential. This paper identifies key conditions for basic operations of floating point data that guarantee lossless transformations. Then, we show four methods that make use of these observations to deliver lossless compression of real datasets, where we improve compression rates up to 40

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/08/2023

Change a Bit to save Bytes: Compression for Floating Point Time-Series Data

The number of IoT devices is expected to continue its dramatic growth in...
research
11/16/2019

IDEALEM: Statistical Similarity Based Data Reduction

Many applications such as scientific simulation, sensing, and power grid...
research
06/28/2023

Erasing-based lossless compression method for streaming floating-point time series

There are a prohibitively large number of floating-point time series dat...
research
02/27/2020

Inline Vector Compression for Computational Physics

A novel inline data compression method is presented for single-precision...
research
02/28/2020

Criteria for the numerical constant recognition

The need for recognition/approximation of functions in terms of elementa...
research
08/23/2023

Adaptive Encoding Strategies for Erasing-Based Lossless Floating-Point Compression

Lossless floating-point time series compression is crucial for a wide ra...
research
02/05/2022

DSSIM: a structural similarity index for floating-point data

Data visualization is a critical component in terms of interacting with ...

Please sign up or login with your details

Forgot password? Click here to reset