Variational message passing for online polynomial NARMAX identification

04/02/2022
by   Wouter Kouw, et al.
2

We propose a variational Bayesian inference procedure for online nonlinear system identification. For each output observation, a set of parameter posterior distributions is updated, which is then used to form a posterior predictive distribution for future outputs. We focus on the class of polynomial NARMAX models, which we cast into probabilistic form and represent in terms of a Forney-style factor graph. Inference in this graph is efficiently performed by a variational message passing algorithm. We show empirically that our variational Bayesian estimator outperforms an online recursive least-squares estimator, most notably in small sample size settings and low noise regimes, and performs on par with an iterative least-squares estimator trained offline.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/25/2021

Reactive Message Passing for Scalable Bayesian Inference

We introduce Reactive Message Passing (RMP) as a framework for executing...
research
09/02/2020

Online system identification in a Duffing oscillator by free energy minimisation

Online system identification is the estimation of parameters of a dynami...
research
04/01/2021

Bayesian Functional Principal Components Analysis via Variational Message Passing

Functional principal components analysis is a popular tool for inference...
research
11/08/2018

A Factor Graph Approach to Automated Design of Bayesian Signal Processing Algorithms

The benefits of automating design cycles for Bayesian inference-based al...
research
12/15/2016

Adversarial Message Passing For Graphical Models

Bayesian inference on structured models typically relies on the ability ...
research
06/09/2023

Automating Model Comparison in Factor Graphs

Bayesian state and parameter estimation have been automated effectively ...
research
11/02/2016

Improving variational methods via pairwise linear response identities

Inference methods are often formulated as variational approximations: th...

Please sign up or login with your details

Forgot password? Click here to reset