Adaptive Path Interpolation for Sparse Systems: Application to a Simple Censored Block Model

06/13/2018
by   Jean Barbier, et al.
0

A new adaptive path interpolation method has been recently developed as a simple and versatile scheme to calculate exactly the asymptotic mutual information of Bayesian inference problems defined on dense factor graphs. These include random linear and generalized estimation, superposition codes, or low rank matrix and tensor estimation. For all these systems the method directly proves in a unified manner that the replica symmetric prediction is exact. When the underlying factor graph of the inference problem is sparse the replica prediction is considerably more complicated and rigorous results are often lacking or obtained by rather complicated methods. In this contribution we extend the adaptive path interpolation method to sparse systems. We concentrate on a Censored Block Model, where hidden variables are measured through a binary erasure channel, for which we fully prove the replica prediction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2019

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

We rigorously derive a single-letter variational expression for the mutu...
research
04/09/2019

Mutual Information for Low-Rank Even-Order Symmetric Tensor Factorization

We consider a statistical model for finite-rank symmetric tensor factori...
research
01/19/2019

The adaptive interpolation method for proving replica formulas. Applications to the Curie-Weiss and Wigner spike models

In this contribution we give a pedagogic introduction to the newly intro...
research
07/15/2020

Inference and mutual information on random factor graphs

Random factor graphs provide a powerful framework for the study of infer...
research
05/16/2020

Information-theoretic limits of a multiview low-rank symmetric spiked matrix model

We consider a generalization of an important class of high-dimensional i...
research
02/25/2018

The Mutual Information in Random Linear Estimation Beyond i.i.d. Matrices

There has been definite progress recently in proving the variational sin...
research
10/27/2021

Performance prediction of massively parallel computation by Bayesian inference

A performance prediction method for massively parallel computation is pr...

Please sign up or login with your details

Forgot password? Click here to reset