Lossy Compression of General Random Variables

11/24/2021
by   Erwin Riegler, et al.
0

This paper is concerned with the lossy compression of general random variables, specifically with rate-distortion theory and quantization of random variables taking values in general measurable spaces such as, e.g., manifolds and fractal sets. Manifold structures are prevalent in data science, e.g., in compressed sensing, machine learning, image processing, and handwritten digit recognition. Fractal sets find application in image compression and in the modeling of Ethernet traffic. Our main contributions are bounds on the rate-distortion function and the quantization error. These bounds are very general and essentially only require the existence of reference measures satisfying certain regularity conditions in terms of small ball probabilities. To illustrate the wide applicability of our results, we particularize them to random variables taking values in i) manifolds, namely, hyperspheres and Grassmannians, and ii) self-similar sets characterized by iterated function systems satisfying the weak separation property.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/24/2018

Rate-Distortion Theory for General Sets and Measures

This paper is concerned with a rate-distortion theory for sequences of i...
research
08/20/2020

Generalizing the de Finetti–Hewitt–Savage theorem

The original formulation of de Finetti's theorem says that an exchangeab...
research
05/29/2019

A New Approach to Lossy Network Compression of a Tuple of Correlated Multivariate Gaussian RVs

The classical Gray and Wyner source coding for a simple network for sour...
research
03/02/2021

Conditional Precedence Orders for Stochastic Comparison of Random Variables

Most of the stochastic orders for comparing random variables, considered...
research
06/06/2018

Learning Kolmogorov Models for Binary Random Variables

We summarize our recent findings, where we proposed a framework for lear...
research
01/10/2013

Wyner's Common Information: Generalizations and A New Lossy Source Coding Interpretation

Wyner's common information was originally defined for a pair of dependen...
research
09/04/2013

Random Variables Recorded under Mutually Exclusive Conditions: Contextuality-by-Default

We present general principles underlying analysis of the dependence of r...

Please sign up or login with your details

Forgot password? Click here to reset