Subadditivity Beyond Trees and the Chi-Squared Mutual Information

02/06/2019
by   Emmanuel Abbe, et al.
0

In 2000, Evans et al. [Eva+00] proved the subadditivity of the mutual information in the broadcasting on tree model with binary vertex labels and symmetric channels. They raised the question of whether such subadditivity extends to loopy graphs in some appropriate way. We recently proposed such an extension that applies to general graphs and binary vertex labels [AB18], using synchronization models and relying on percolation bounds. This extension requires however the edge channels to be symmetric on the product of the adjacent spins. A more general version of such a percolation bound that applies to asymmetric channels is also obtained in [PW18], relying on the SDPI, but the subadditivity property does not follow with such generalizations. In this note, we provide a new result showing that the subadditivity property still holds for arbitrary (asymmetric) channels acting on the product of spins, when the graphs are restricted to be series-parallel. The proof relies on the use of the Chi-squared mutual information rather than the classical mutual information, and various properties of the former are discussed. We also present a generalization of the broadcasting on tree model (the synchronization on tree) where the bound from [PW18] relying on the SPDI can be significantly looser than the bound resulting from the Chi-squared subadditivity property presented here.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/08/2018

An Information-Percolation Bound for Spin Synchronization on General Graphs

This paper considers the problem of reconstructing n independent uniform...
research
03/04/2023

Derivatives of mutual information in Gaussian channels

We derive a general formula for the derivatives of mutual information be...
research
01/23/2020

On lower semicontinuity of the quantum conditional mutual information and its corollaries

It is well known that the quantum mutual information and its conditional...
research
05/15/2020

Broadcasting on trees near criticality

We revisit the problem of broadcasting on d-ary trees: starting from a B...
research
03/26/2023

Uniqueness of BP fixed point for the Potts model and applications to community detection

In the study of sparse stochastic block model (SBM) one needs to analyze...
research
04/11/2023

Breakdown of a concavity property of mutual information for non-Gaussian channels

Let S and S̃ be two independent and identically distributed random varia...
research
10/23/2021

Symmetric properties and two variants of shuffle-cubes

Li et al. in [Inf. Process. Lett. 77 (2001) 35–41] proposed the shuffle ...

Please sign up or login with your details

Forgot password? Click here to reset