Fundamental Linear Algebra Problem of Gaussian Inference

10/15/2020
by   Timothy D. Barfoot, et al.
0

Underlying many Bayesian inference techniques that seek to approximate the posterior as a Gaussian distribution is a fundamental linear algebra problem that must be solved for both the mean and key entries of the covariance. Even when the true posterior is not Gaussian (e.g., in the case of nonlinear measurement functions) we can use variational schemes that repeatedly solve this linear algebra problem at each iteration. In most cases, the question is not whether a solution to this problem exists, but rather how we can exploit problem-specific structure to find it efficiently. Our contribution is to clearly state the Fundamental Linear Algebra Problem of Gaussian Inference (FLAPOGI) and to provide a novel presentation (using Kronecker algebra) of the not-so-well-known result of Takahashi et al. (1973) that makes it possible to solve for key entries of the covariance matrix. We first provide a global solution and then a local version that can be implemented using local message passing amongst a collection of agents calculating in parallel. Contrary to belief propagation, our local scheme is guaranteed to converge in both the mean and desired covariance quantities to the global solution even when the underlying factor graph is loopy; in the case of synchronous updates, we provide a bound on the number of iterations required for convergence. Compared to belief propagation, this guaranteed convergence comes at the cost of additional storage, calculations, and communication links in the case of loops; however, we show how these can be automatically constructed on the fly using only local information.

READ FULL TEXT

page 6

page 7

research
05/20/2020

The Inverse G-Wishart Distribution and Variational Message Passing

Message passing on a factor graph is a powerful paradigm for the coding ...
research
11/07/2016

Convergence Analysis of Distributed Inference with Vector-Valued Gaussian Belief Propagation

This paper considers inference over distributed linear Gaussian models u...
research
06/20/2012

Convergent Propagation Algorithms via Oriented Trees

Inference problems in graphical models are often approximated by casting...
research
07/05/2021

A visual introduction to Gaussian Belief Propagation

In this article, we present a visual introduction to Gaussian Belief Pro...
research
03/30/2016

On the Geometry of Message Passing Algorithms for Gaussian Reciprocal Processes

Reciprocal processes are acausal generalizations of Markov processes int...
research
11/09/2019

Exactly Sparse Gaussian Variational Inference with Application to Derivative-Free Batch Nonlinear State Estimation

We present a Gaussian Variational Inference (GVI) technique that can be ...
research
05/03/2009

Gaussian Belief with dynamic data and in dynamic network

In this paper we analyse Belief Propagation over a Gaussian model in a d...

Please sign up or login with your details

Forgot password? Click here to reset