Zero-Temperature Limit of a Convergent Algorithm to Minimize the Bethe Free Energy

12/22/2011
by   Tomas Werner, et al.
0

After the discovery that fixed points of loopy belief propagation coincide with stationary points of the Bethe free energy, several researchers proposed provably convergent algorithms to directly minimize the Bethe free energy. These algorithms were formulated only for non-zero temperature (thus finding fixed points of the sum-product algorithm) and their possible extension to zero temperature is not obvious. We present the zero-temperature limit of the double-loop algorithm by Heskes, which converges a max-product fixed point. The inner loop of this algorithm is max-sum diffusion. Under certain conditions, the algorithm combines the complementary advantages of the max-product belief propagation and max-sum diffusion (LP relaxation): it yields good approximation of both ground states and max-marginals.

READ FULL TEXT
research
07/02/2022

Local Max-Entropy and Free Energy Principles Solved by Belief Propagation

A statistical system is classically defined on a set of microstates E by...
research
05/05/2011

Interpreting Graph Cuts as a Max-Product Algorithm

The maximum a posteriori (MAP) configuration of binary variable models w...
research
07/04/2012

On the optimality of tree-reweighted max-product message-passing

Tree-reweighted max-product (TRW) message passing is a modified form of ...
research
08/27/2013

Improving Sparse Associative Memories by Escaping from Bogus Fixed Points

The Gripon-Berrou neural network (GBNN) is a recently invented recurrent...
research
02/17/2010

Graph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation

We propose a new approach to the analysis of Loopy Belief Propagation (L...
research
03/03/2011

Loopy Belief Propagation, Bethe Free Energy and Graph Zeta Function

We propose a new approach to the theoretical analysis of Loopy Belief Pr...
research
06/05/2013

Loop Calculus and Bootstrap-Belief Propagation for Perfect Matchings on Arbitrary Graphs

This manuscript discusses computation of the Partition Function (PF) and...

Please sign up or login with your details

Forgot password? Click here to reset