Message Scheduling for Performant, Many-Core Belief Propagation

09/24/2019
by   Mark Van der Merwe, et al.
0

Belief Propagation (BP) is a message-passing algorithm for approximate inference over Probabilistic Graphical Models (PGMs), finding many applications such as computer vision, error-correcting codes, and protein-folding. While general, the convergence and speed of the algorithm has limited its practical use on difficult inference problems. As an algorithm that is highly amenable to parallelization, many-core Graphical Processing Units (GPUs) could significantly improve BP performance. Improving BP through many-core systems is non-trivial: the scheduling of messages in the algorithm strongly affects performance. We present a study of message scheduling for BP on GPUs. We demonstrate that BP exhibits a tradeoff between speed and convergence based on parallelism and show that existing message schedulings are not able to utilize this tradeoff. To this end, we present a novel randomized message scheduling approach, Randomized BP (RnBP), which outperforms existing methods on the GPU.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2020

α Belief Propagation for Approximate Inference

Belief propagation (BP) algorithm is a widely used message-passing metho...
research
09/24/2022

Deep Attentive Belief Propagation: Integrating Reasoning and Learning for Solving Constraint Optimization Problems

Belief Propagation (BP) is an important message-passing algorithm for va...
research
11/14/2013

Anytime Belief Propagation Using Sparse Domains

Belief Propagation has been widely used for marginal inference, however ...
research
11/04/2011

Stochastic Belief Propagation: A Low-Complexity Alternative to the Sum-Product Algorithm

The sum-product or belief propagation (BP) algorithm is a widely-used me...
research
10/27/2021

Deep learning via message passing algorithms based on belief propagation

Message-passing algorithms based on the Belief Propagation (BP) equation...
research
06/20/2012

Improved Dynamic Schedules for Belief Propagation

Belief propagation and its variants are popular methods for approximate ...
research
02/14/2012

Belief Propagation by Message Passing in Junction Trees: Computing Each Message Faster Using GPU Parallelization

Compiling Bayesian networks (BNs) to junction trees and performing belie...

Please sign up or login with your details

Forgot password? Click here to reset