Factor graph fragmentization of expectation propagation

01/16/2018
by   Wilson Y. Chen, et al.
0

Expectation propagation is a general approach to fast approximate inference for graphical models. The existing literature treats models separately when it comes to deriving and coding expectation propagation inference algorithms. This comes at the cost of similar, long-winded algebraic steps being repeated and slowing down algorithmic development. We demonstrate how factor graph fragmentization can overcome this impediment. This involves adoption of the message passing on a factor graph approach to expectation propagation and identification of factor graph sub-graphs, which we call fragments, that are common to wide classes of models. Key fragments and their corresponding messages are catalogued which means that their algebra does not need to be repeated. This allows compartmentalization of coding and efficient software development.

READ FULL TEXT
research
05/20/2020

The Inverse G-Wishart Distribution and Variational Message Passing

Message passing on a factor graph is a powerful paradigm for the coding ...
research
01/02/2015

Passing Expectation Propagation Messages with Kernel Methods

We propose to learn a kernel-based message operator which takes as input...
research
07/12/2021

Generalization of graph network inferences in higher-order probabilistic graphical models

Probabilistic graphical models provide a powerful tool to describe compl...
research
09/25/2014

Revisiting Algebra and Complexity of Inference in Graphical Models

This paper studies the form and complexity of inference in graphical mod...
research
12/16/2010

Fast Convergent Algorithms for Expectation Propagation Approximate Bayesian Inference

We propose a novel algorithm to solve the expectation propagation relaxa...
research
01/16/2018

Expectation Propagation for Approximate Inference: Free Probability Framework

We study asymptotic properties of expectation propagation (EP) - a metho...
research
04/18/2012

Message passing with relaxed moment matching

Bayesian learning is often hampered by large computational expense. As a...

Please sign up or login with your details

Forgot password? Click here to reset