Merging Belief Propagation and the Mean Field Approximation: A Free Energy Approach

12/02/2011
by   Erwin Riegler, et al.
0

We present a joint message passing approach that combines belief propagation and the mean field approximation. Our analysis is based on the region-based free energy approximation method proposed by Yedidia et al. We show that the message passing fixed-point equations obtained with this combination correspond to stationary points of a constrained region-based free energy approximation. Moreover, we present a convergent implementation of these message passing fixedpoint equations provided that the underlying factor graph fulfills certain technical conditions. In addition, we show how to include hard constraints in the part of the factor graph corresponding to belief propagation. Finally, we demonstrate an application of our method to iterative channel estimation and decoding in an orthogonal frequency division multiplexing (OFDM) system.

READ FULL TEXT
research
06/17/2020

Region-based Energy Neural Network for Approximate Inference

Region-based free energy was originally proposed for generalized belief ...
research
01/28/2022

Regionalized optimization

Yedidia, Freeman, Weiss have shown in their reference article, "Construc...
research
01/16/2014

Properties of Bethe Free Energies and Message Passing in Gaussian Models

We address the problem of computing approximate marginals in Gaussian pr...
research
05/22/2015

Diffusion Methods for Classification with Pairwise Relationships

We define two algorithms for propagating information in classification p...
research
11/24/2011

Receiver Architectures for MIMO-OFDM Based on a Combined VMP-SP Algorithm

Iterative information processing, either based on heuristics or analytic...
research
10/19/2012

Pairwise MRF Calibration by Perturbation of the Bethe Reference Point

We investigate different ways of generating approximate solutions to the...
research
05/24/2019

Fast Convergence of Belief Propagation to Global Optima: Beyond Correlation Decay

Belief propagation is a fundamental message-passing algorithm for probab...

Please sign up or login with your details

Forgot password? Click here to reset