Primal View on Belief Propagation

03/15/2012
by   Tomas Werner, et al.
0

It is known that fixed points of loopy belief propagation (BP) correspond to stationary points of the Bethe variational problem, where we minimize the Bethe free energy subject to normalization and marginalization constraints. Unfortunately, this does not entirely explain BP because BP is a dual rather than primal algorithm to solve the Bethe variational problem -- beliefs are infeasible before convergence. Thus, we have no better understanding of BP than as an algorithm to seek for a common zero of a system of non-linear functions, not explicitly related to each other. In this theoretical paper, we show that these functions are in fact explicitly related -- they are the partial derivatives of a single function of reparameterizations. That means, BP seeks for a stationary point of a single function, without any constraints. This function has a very natural form: it is a linear combination of local log-partition functions, exactly as the Bethe entropy is the same linear combination of local entropies.

READ FULL TEXT
research
06/20/2012

MAP Estimation, Linear Programming and Belief Propagation with Convex Free Energies

Finding the most probable assignment (MAP) in a general graphical model ...
research
05/20/2016

Fixed Points of Belief Propagation -- An Analysis via Polynomial Homotopy Continuation

Belief propagation (BP) is an iterative method to perform approximate in...
research
03/03/2017

Gauging Variational Inference

Computing partition function is the most important statistical inference...
research
10/24/2021

Application and Analysis of Expectation Propagation Algorithm in the Binary Erasure Quantization

Regarding the widespread utilization of big data, compression and recons...
research
06/16/2014

CCCP Algorithms to Minimize the Bethe free energy of 3-SAT Problem

The k-sat problem is a prototypical constraint satisfaction problem. The...
research
07/27/2016

Multiple scan data association by convex variational inference

Data association, the reasoning over correspondence between targets and ...
research
06/05/2013

Loop Calculus and Bootstrap-Belief Propagation for Perfect Matchings on Arbitrary Graphs

This manuscript discusses computation of the Partition Function (PF) and...

Please sign up or login with your details

Forgot password? Click here to reset