Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

02/19/2019
by   Jean Barbier, et al.
0

We rigorously derive a single-letter variational expression for the mutual information of the asymmetric two-groups stochastic block model in the dense graph regime. Existing proofs in the literature are indirect, as they involve mapping the model to a rank-one matrix estimation problem whose mutual information is then determined by a combination of methods (e.g., interpolation, cavity, algorithmic, spatial coupling). In this contribution we provide a self-contained direct method using only the recently introduced adaptive interpolation method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/25/2018

The Mutual Information in Random Linear Estimation Beyond i.i.d. Matrices

There has been definite progress recently in proving the variational sin...
research
06/13/2018

Adaptive Path Interpolation for Sparse Systems: Application to a Simple Censored Block Model

A new adaptive path interpolation method has been recently developed as ...
research
04/09/2019

Mutual Information for Low-Rank Even-Order Symmetric Tensor Factorization

We consider a statistical model for finite-rank symmetric tensor factori...
research
07/15/2020

Inference and mutual information on random factor graphs

Random factor graphs provide a powerful framework for the study of infer...
research
01/19/2019

The adaptive interpolation method for proving replica formulas. Applications to the Curie-Weiss and Wigner spike models

In this contribution we give a pedagogic introduction to the newly intro...
research
06/11/2018

Application of information-percolation method to reconstruction problems on graphs

In this paper we propose a method of proving impossibility results based...
research
05/24/2018

Entropy and mutual information in models of deep neural networks

We examine a class of deep learning models with a tractable method to co...

Please sign up or login with your details

Forgot password? Click here to reset