Multiple-Output Channel Simulation and Lossy Compression of Probability Distributions

by   Chak Fung Choi, et al.

We consider a variant of the channel simulation problem with a single input and multiple outputs, where Alice observes a probability distribution P from a set of prescribed probability distributions 𝒫, and sends a prefix-free codeword W to Bob to allow him to generate n i.i.d. random variables X_1,X_2,...,X_n which follow the distribution P. This can also be regarded as a lossy compression setting for probability distributions. This paper describes encoding schemes for three cases of P: P is a distribution over positive integers, P is a continuous distribution over [0,1] with a non-increasing pdf, and P is a continuous distribution over [0,∞) with a non-increasing pdf. We show that the growth rate of the expected codeword length is sub-linear in n when a power law bound is satisfied. An application of multiple-outputs channel simulation is the compression of probability distributions.



There are no comments yet.


page 5

βˆ™ 04/13/2018

Distribution Regression Network

We introduce our Distribution Regression Network (DRN) which performs re...
βˆ™ 06/11/2021

Encoding of probability distributions for Asymmetric Numeral Systems

Many data compressors regularly encode probability distributions for ent...
βˆ™ 04/17/2018

Benford or not Benford: a systematic but not always well-founded use of an elegant law in experimental fields

In this paper, we will see that the proportion of d as leading digit, d ...
βˆ™ 05/14/2021

From Multisets over Distributions to Distributions over Multisets

A well-known challenge in the semantics of programming languages is how ...
βˆ™ 08/29/2020

Modeling of Daily Precipitation Amounts Using the Mixed Gamma Weibull Distribution

By recognizing that the main difficulty of the modeling of daily precipi...
βˆ™ 06/17/2018

ZICS: an application for calculating the stationary probability distribution of stochastic reaction networks

Stochastic formalisms are necessary to describe the behavior of many bio...
βˆ™ 04/01/2021

Statistical significance revisited

Statistical significance measures the reliability of a result obtained f...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.