Log In Sign Up

Belief Propagation Reloaded: Learning BP-Layers for Labeling Problems

by   Patrick Knöbelreiter, et al.

It has been proposed by many researchers that combining deep neural networks with graphical models can create more efficient and better regularized composite models. The main difficulties in implementing this in practice are associated with a discrepancy in suitable learning objectives as well as with the necessity of approximations for the inference. In this work we take one of the simplest inference methods, a truncated max-product Belief Propagation, and add what is necessary to make it a proper component of a deep learning model: We connect it to learning formulations with losses on marginals and compute the backprop operation. This BP-Layer can be used as the final or an intermediate block in convolutional neural networks (CNNs), allowing us to design a hierarchical model composing BP inference and CNNs at different scale levels. The model is applicable to a range of dense prediction problems, is well-trainable and provides parameter-efficient and robust solutions in stereo, optical flow and semantic segmentation.


page 1

page 7

page 14

page 15

page 16

page 17

page 18

page 19


Counting Belief Propagation

A major benefit of graphical models is that most knowledge is captured i...

Accuracy Bounds for Belief Propagation

The belief propagation (BP) algorithm is widely applied to perform appro...

BP-MVSNet: Belief-Propagation-Layers for Multi-View-Stereo

In this work, we propose BP-MVSNet, a convolutional neural network (CNN)...

MAP Estimation, Linear Programming and Belief Propagation with Convex Free Energies

Finding the most probable assignment (MAP) in a general graphical model ...

A Max-Sum algorithm for training discrete neural networks

We present an efficient learning algorithm for the problem of training n...

Belief Propagation in Conditional RBMs for Structured Prediction

Restricted Boltzmann machines (RBMs) and conditional RBMs (CRBMs) are po...

An Embarrassingly Simple Speed-Up of Belief Propagation with Robust Potentials

We present an exact method of greatly speeding up belief propagation (BP...