Convergence of Generalized Belief Propagation Algorithm on Graphs with Motifs

12/11/2021
by   Yitao Chen, et al.
0

Belief propagation is a fundamental message-passing algorithm for numerous applications in machine learning. It is known that belief propagation algorithm is exact on tree graphs. However, belief propagation is run on loopy graphs in most applications. So, understanding the behavior of belief propagation on loopy graphs has been a major topic for researchers in different areas. In this paper, we study the convergence behavior of generalized belief propagation algorithm on graphs with motifs (triangles, loops, etc.) We show under a certain initialization, generalized belief propagation converges to the global optimum of the Bethe free energy for ferromagnetic Ising models on graphs with motifs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2019

Fast Convergence of Belief Propagation to Global Optima: Beyond Correlation Decay

Belief propagation is a fundamental message-passing algorithm for probab...
research
10/05/2016

Lifted Message Passing for the Generalized Belief Propagation

We introduce the lifted Generalized Belief Propagation (GBP) message pas...
research
10/02/2022

Belief propagation generalizes backpropagation

The two most important algorithms in artificial intelligence are backpro...
research
02/14/2012

Belief Propagation by Message Passing in Junction Trees: Computing Each Message Faster Using GPU Parallelization

Compiling Bayesian networks (BNs) to junction trees and performing belie...
research
06/30/2016

Lifted Region-Based Belief Propagation

Due to the intractable nature of exact lifted inference, research has re...
research
07/05/2021

A visual introduction to Gaussian Belief Propagation

In this article, we present a visual introduction to Gaussian Belief Pro...
research
05/16/2018

Max-Product for Maximum Weight Matching - Revisited

We focus on belief propagation for the assignment problem, also known as...

Please sign up or login with your details

Forgot password? Click here to reset