α Belief Propagation for Approximate Inference

06/27/2020
by   Dong Liu, et al.
9

Belief propagation (BP) algorithm is a widely used message-passing method for inference in graphical models. BP on loop-free graphs converges in linear time. But for graphs with loops, BP's performance is uncertain, and the understanding of its solution is limited. To gain a better understanding of BP in general graphs, we derive an interpretable belief propagation algorithm that is motivated by minimization of a localized α-divergence. We term this algorithm as α belief propagation (α-BP). It turns out that α-BP generalizes standard BP. In addition, this work studies the convergence properties of α-BP. We prove and offer the convergence conditions for α-BP. Experimental simulations on random graphs validate our theoretical results. The application of α-BP to practical problems is also demonstrated.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/23/2019

α Belief Propagation as Fully Factorized Approximation

Belief propagation (BP) can do exact inference in loop-free graphs, but ...
research
06/20/2012

Accuracy Bounds for Belief Propagation

The belief propagation (BP) algorithm is widely applied to perform appro...
research
09/24/2019

Message Scheduling for Performant, Many-Core Belief Propagation

Belief Propagation (BP) is a message-passing algorithm for approximate i...
research
10/06/2011

Characterizing and Improving Generalized Belief Propagation Algorithms on the 2D Edwards-Anderson Model

We study the performance of different message passing algorithms in the ...
research
02/17/2015

The Linearization of Belief Propagation on Pairwise Markov Networks

Belief Propagation (BP) is a widely used approximation for exact probabi...
research
05/10/2011

Feedback Message Passing for Inference in Gaussian Graphical Models

While loopy belief propagation (LBP) performs reasonably well for infere...
research
12/04/2018

Self-Guided Belief Propagation -- A Homotopy Continuation Method

We propose self-guided belief propagation (SBP) that modifies belief pro...

Please sign up or login with your details

Forgot password? Click here to reset