An Information-Theoretic Proof of a Finite de Finetti Theorem

04/08/2021
by   Lampros Gavalakis, et al.
0

A finite form of de Finetti's representation theorem is established using elementary information-theoretic tools: The distribution of the first k random variables in an exchangeable binary vector of length n≥ k is close to a mixture of product distributions. Closeness is measured in terms of the relative entropy and an explicit bound is provided.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2023

A Third Information-Theoretic Approach to Finite de Finetti Theorems

A new finite form of de Finetti's representation theorem is established ...
research
02/12/2022

An Information-Theoretic Proof of the Kac–Bernstein Theorem

A short, information-theoretic proof of the Kac–Bernstein theorem, which...
research
04/11/2022

Information in probability: Another information-theoretic proof of a finite de Finetti theorem

We recall some of the history of the information-theoretic approach to d...
research
09/02/2021

An Information-Theoretic View of Stochastic Localization

Given a probability measure μ over ℝ^n, it is often useful to approximat...
research
01/18/2019

An information theoretic model for summarization, and some basic results

A basic information theoretic model for summarization is formulated. Her...
research
08/30/2020

Sharp finite-sample large deviation bounds for independent variables

We show an extension of Sanov's theorem in large deviations theory, cont...
research
06/19/2020

Entropy and relative entropy from information-theoretic principles

We introduce an axiomatic approach to entropies and relative entropies t...

Please sign up or login with your details

Forgot password? Click here to reset