Expectation Propogation for approximate inference in dynamic Bayesian networks

12/12/2012
by   Tom Heskes, et al.
0

We describe expectation propagation for approximate inference in dynamic Bayesian networks as a natural extension of Pearl s exact belief propagation.Expectation propagation IS a greedy algorithm, converges IN many practical cases, but NOT always.We derive a DOUBLE - loop algorithm, guaranteed TO converge TO a local minimum OF a Bethe free energy.Furthermore, we show that stable fixed points OF (damped) expectation propagation correspond TO local minima OF this free energy, but that the converse need NOT be the CASE .We illustrate the algorithms BY applying them TO switching linear dynamical systems AND discuss implications FOR approximate inference IN general Bayesian networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/19/2012

Approximate Inference and Constrained Optimization

Loopy and generalized belief propagation are popular algorithms for appr...
research
01/10/2013

Expectation Propagation for approximate Bayesian inference

This paper presents a new deterministic approximation technique in Bayes...
research
12/10/2011

Convergent Expectation Propagation in Linear Models with Spike-and-slab Priors

Exact inference in the linear regression model with spike and slab prior...
research
01/10/2013

The Factored Frontier Algorithm for Approximate Inference in DBNs

The Factored Frontier (FF) algorithm is a simple approximate inferenceal...
research
12/16/2010

Fast Convergent Algorithms for Expectation Propagation Approximate Bayesian Inference

We propose a novel algorithm to solve the expectation propagation relaxa...
research
07/04/2012

The DLR Hierarchy of Approximate Inference

We propose a hierarchy for approximate inference based on the Dobrushin,...
research
05/22/2018

Fast and Accurate Binary Response Mixed Model Analysis via Expectation Propagation

Expectation propagation is a general prescription for approximation of i...

Please sign up or login with your details

Forgot password? Click here to reset