Uniqueness of BP fixed point for the Potts model and applications to community detection

03/26/2023
by   Yuzhou Gu, et al.
0

In the study of sparse stochastic block model (SBM) one needs to analyze a distributional recursion, known as belief propagation (BP) on a tree. Uniqueness of the fixed point of this recursion implies several results about the SBM, including optimal recovery algorithms for SBM (Mossel et al. (2016)) and SBM with side information (Mossel and Xu (2016)), and a formula for SBM mutual information (Abbe et al. (2021)). The 2-community case corresponds to an Ising model, for which Yu and Polyanskiy (2022) established uniqueness for all cases. Here, we analyze broadcasting of q-ary spins on a Galton-Watson tree with expected offspring degree d and Potts channels with second-largest eigenvalue λ. We allow for the intermediate vertices to be observed through noisy channels (side information) We prove BP uniqueness holds with and without side information when dλ^2 ≥ 1 + C max{λ, q^-1}log q for some absolute constant C>0 independent of q,d,λ. For large q and λ = o(1/log q), this is asymptotically achieving the Kesten-Stigum threshold dλ^2=1. These results imply mutual information formula and optimal recovery algorithms for the q-community SBM in the corresponding ranges. For q≥ 4, Sly (2011); Mossel et al. (2022) shows that there exist choices of q,d,λ below Kesten-Stigum (i.e. dλ^2 < 1) but reconstruction is possible. Somewhat surprisingly, we show that in such regimes BP uniqueness does not hold at least in the presence of weak side information. Our technical tool is a theory of q-ary symmetric channels, that we initiate here, generalizing the classical and widely-utilized information-theoretic characterization of BMS (binary memoryless symmetric) channels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/28/2022

Ising Model on Locally Tree-like Graphs: Uniqueness of Solutions to Cavity Equations

In the study of Ising models on large locally tree-like graphs, in both ...
research
05/20/2016

Fixed Points of Belief Propagation -- An Analysis via Polynomial Homotopy Continuation

Belief propagation (BP) is an iterative method to perform approximate in...
research
01/29/2021

Stochastic block model entropy and broadcasting on trees with survey

The limit of the entropy in the stochastic block model (SBM) has been ch...
research
04/10/2018

Uniqueness for the 3-State Antiferromagnetic Potts Model on the Tree

The antiferromagnetic q-state Potts model is perhaps the most canonical ...
research
02/06/2019

Subadditivity Beyond Trees and the Chi-Squared Mutual Information

In 2000, Evans et al. [Eva+00] proved the subadditivity of the mutual in...
research
03/26/2023

Weak Recovery Threshold for the Hypergraph Stochastic Block Model

We study the problem of weak recovery for the r-uniform hypergraph stoch...
research
05/11/2020

Non-linear Log-Sobolev inequalities for the Potts semigroup and applications to reconstruction problems

Consider a Markov process with state space [k], which jumps continuously...

Please sign up or login with your details

Forgot password? Click here to reset