A Note on the Accuracy of Variational Bayes in State Space Models: Inference and Prediction

06/23/2021
by   David T. Frazier, et al.
0

Using theoretical and numerical results, we document the accuracy of commonly applied variational Bayes methods across a range of state space models. The results demonstrate that, in terms of accuracy on fixed parameters, there is a clear hierarchy in terms of the methods, with approaches that do not approximate the states yielding superior accuracy over methods that do. We also document numerically that the inferential discrepancies between the various methods often yield only small discrepancies in predictive accuracy over small out-of-sample evaluation periods. Nevertheless, in certain settings, these predictive discrepancies can become marked over longer out-of-sample periods. This finding indicates that the invariance of predictive results to inferential inaccuracy, which has been an oft-touted point made by practitioners seeking to justify the use of variational inference, is not ubiquitous and must be assessed on a case-by-case basis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/20/2016

Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data

We introduce Deep Variational Bayes Filters (DVBF), a new method for uns...
research
03/01/2021

A practical tutorial on Variational Bayes

This tutorial gives a quick introduction to Variational Bayes (VB), also...
research
10/20/2022

Efficient variational approximations for state space models

Variational Bayes methods are a scalable estimation approach for many co...
research
11/02/2014

Population Empirical Bayes

Bayesian predictive inference analyzes a dataset to make predictions abo...
research
07/25/2013

Streaming Variational Bayes

We present SDA-Bayes, a framework for (S)treaming, (D)istributed, (A)syn...
research
06/01/2022

Amortized backward variational inference in nonlinear state-space models

We consider the problem of state estimation in general state-space model...
research
11/20/2015

Variational Bayes Factor Analysis for i-Vector Extraction

In this document we are going to derive the equations needed to implemen...

Please sign up or login with your details

Forgot password? Click here to reset