Loopy Belief Propagation, Bethe Free Energy and Graph Zeta Function

03/03/2011
by   Yusuke Watanabe, et al.
0

We propose a new approach to the theoretical analysis of Loopy Belief Propagation (LBP) and the Bethe free energy (BFE) by establishing a formula to connect LBP and BFE with a graph zeta function. The proposed approach is applicable to a wide class of models including multinomial and Gaussian types. The connection derives a number of new theoretical results on LBP and BFE. This paper focuses two of such topics. One is the analysis of the region where the Hessian of the Bethe free energy is positive definite, which derives the non-convexity of BFE for graphs with multiple cycles, and a condition of convexity on a restricted set. This analysis also gives a new condition for the uniqueness of the LBP fixed point. The other result is to clarify the relation between the local stability of a fixed point of LBP and local minima of the BFE, which implies, for example, that a locally stable fixed point of the Gaussian LBP is a local minimum of the Gaussian Bethe free energy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2010

Graph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation

We propose a new approach to the analysis of Loopy Belief Propagation (L...
research
07/19/2012

Local stability of Belief Propagation algorithm with multiple fixed points

A number of problems in statistical physics and computer science can be ...
research
01/10/2013

Belief Optimization for Binary Networks: A Stable Alternative to Loopy Belief Propagation

We present a novel inference algorithm for arbitrary, binary, undirected...
research
05/05/2011

Interpreting Graph Cuts as a Max-Product Algorithm

The maximum a posteriori (MAP) configuration of binary variable models w...
research
04/08/2005

Convexity Analysis of Snake Models Based on Hamiltonian Formulation

This paper presents a convexity analysis for the dynamic snake model bas...
research
11/28/2022

Ising Model on Locally Tree-like Graphs: Uniqueness of Solutions to Cavity Equations

In the study of Ising models on large locally tree-like graphs, in both ...
research
12/22/2011

Zero-Temperature Limit of a Convergent Algorithm to Minimize the Bethe Free Energy

After the discovery that fixed points of loopy belief propagation coinci...

Please sign up or login with your details

Forgot password? Click here to reset