Block Belief Propagation for Parameter Learning in Markov Random Fields

11/09/2018
by   You Lu, et al.
0

Traditional learning methods for training Markov random fields require doing inference over all variables to compute the likelihood gradient. The iteration complexity for those methods therefore scales with the size of the graphical models. In this paper, we propose block belief propagation learning (BBPL), which uses block-coordinate updates of approximate marginals to compute approximate gradients, removing the need to compute inference on the entire graphical model. Thus, the iteration complexity of BBPL does not scale with the size of the graphs. We prove that the method converges to the same solution as that obtained by using full inference per iteration, despite these approximations, and we empirically demonstrate its scalability improvements over standard training methods.

READ FULL TEXT

page 6

page 10

research
06/20/2012

Accuracy Bounds for Belief Propagation

The belief propagation (BP) algorithm is widely applied to perform appro...
research
04/21/2020

Rigorous Explanation of Inference on Probabilistic Graphical Models

Probabilistic graphical models, such as Markov random fields (MRF), expl...
research
02/22/2019

Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation

Recent studies have suggested that the cognitive process of the human br...
research
09/26/2013

Hinge-loss Markov Random Fields: Convex Inference for Structured Prediction

Graphical models for structured domains are powerful tools, but the comp...
research
01/15/2013

Learning Graphical Model Parameters with Approximate Marginal Inference

Likelihood based-learning of graphical models faces challenges of comput...
research
12/01/2017

Susceptibility Propagation by Using Diagonal Consistency

A susceptibility propagation that is constructed by combining a belief p...
research
03/16/2015

Statistical Analysis of Loopy Belief Propagation in Random Fields

Loopy belief propagation (LBP), which is equivalent to the Bethe approxi...

Please sign up or login with your details

Forgot password? Click here to reset