A Third Information-Theoretic Approach to Finite de Finetti Theorems

04/11/2023
by   Mario Berta, et al.
0

A new finite form of de Finetti's representation theorem is established using elementary information-theoretic tools. The distribution of the first k random variables in an exchangeable vector of n≥ k random variables is close to a mixture of product distributions. Closeness is measured in terms of the relative entropy and an explicit bound is provided. This bound is tighter than those obtained via earlier information-theoretic proofs, and its utility extends to random variables taking values in general spaces. The core argument employed has its origins in the quantum information-theoretic literature.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2021

An Information-Theoretic Proof of a Finite de Finetti Theorem

A finite form of de Finetti's representation theorem is established usin...
research
10/08/2019

An Information-theoretic Approach to Unsupervised Feature Selection for High-Dimensional Data

In this paper, we propose an information-theoretic approach to design th...
research
04/11/2022

Information in probability: Another information-theoretic proof of a finite de Finetti theorem

We recall some of the history of the information-theoretic approach to d...
research
12/12/2019

An Integral Representation of the Logarithmic Function with Applications in Information Theory

We explore a well-known integral representation of the logarithmic funct...
research
02/28/2022

Entropic Hyper-Connectomes Computation and Analysis

Brain function and connectivity is a pressing mystery in medicine relate...
research
08/30/2020

Sharp finite-sample large deviation bounds for independent variables

We show an extension of Sanov's theorem in large deviations theory, cont...
research
09/02/2021

An Information-Theoretic View of Stochastic Localization

Given a probability measure μ over ℝ^n, it is often useful to approximat...

Please sign up or login with your details

Forgot password? Click here to reset