A Cluster-Cumulant Expansion at the Fixed Points of Belief Propagation

10/16/2012
by   Max Welling, et al.
0

We introduce a new cluster-cumulant expansion (CCE) based on the fixed points of iterative belief propagation (IBP). This expansion is similar in spirit to the loop-series (LS) recently introduced in [1]. However, in contrast to the latter, the CCE enjoys the following important qualities: 1) it is defined for arbitrary state spaces 2) it is easily extended to fixed points of generalized belief propagation (GBP), 3) disconnected groups of variables will not contribute to the CCE and 4) the accuracy of the expansion empirically improves upon that of the LS. The CCE is based on the same Möbius transform as the Kikuchi approximation, but unlike GBP does not require storing the beliefs of the GBP-clusters nor does it suffer from convergence issues during belief updating.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/19/2012

Local stability of Belief Propagation algorithm with multiple fixed points

A number of problems in statistical physics and computer science can be ...
research
10/19/2012

A Simple Insight into Iterative Belief Propagation's Success

In Non - ergodic belief networks the posterior belief OF many queries gi...
research
06/20/2018

Efficient inference in stochastic block models with vertex labels

We study the stochastic block model with two communities where vertices ...
research
07/11/2012

On the Choice of Regions for Generalized Belief Propagation

Generalized belief propagation (GBP) has proven to be a promising techni...
research
01/30/2013

Empirical Evaluation of Approximation Algorithms for Probabilistic Decoding

It was recently shown that the problem of decoding messages transmitted ...
research
01/23/2013

Probabilistic Belief Change: Expansion, Conditioning and Constraining

The AGM theory of belief revision has become an important paradigm for i...
research
09/10/2015

Density Evolution in the Degree-correlated Stochastic Block Model

There is a recent surge of interest in identifying the sharp recovery th...

Please sign up or login with your details

Forgot password? Click here to reset