Online Approximate Bayesian learning

07/09/2020
by   Mathieu Gerber, et al.
0

We introduce in this work a new method for online approximate Bayesian learning, whose main idea is to approximate the sequence (π_t)_t≥ 1 of posterior distributions by a sequence (π̃_t)_t≥ 1 which (i) can be estimated in an online fashion using sequential Monte Carlo methods and (ii) is shown to converge to the same distribution as the sequence (π_t)_t≥ 1, under weak assumptions on the statistical model at hand. In its simplest version, the proposed approach amounts to take for (π̃_t)_t≥ 1 the sequence of filtering distributions associated to a particular state-space model, and to approximate this sequence using a standard particle filter algorithm. We illustrate on several challenging examples the benefits of this procedure for online approximate Bayesian parameter inference, and with one real data example we show that its online predictive performance can significantly outperform that of stochastic gradient descent and of streaming variational Bayes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/06/2017

Learning of state-space models with highly informative observations: a tempered Sequential Monte Carlo solution

Probabilistic (or Bayesian) modeling and learning offers interesting pos...
research
06/23/2015

Bayesian optimisation for fast approximate inference in state-space models with intractable likelihoods

We consider the problem of approximate Bayesian parameter inference in n...
research
09/28/2018

Perturbed Bayesian Inference for Online Parameter Estimation

We introduce a new Bayesian based approach for online parameter inferenc...
research
06/04/2019

Streaming Variational Monte Carlo

Nonlinear state-space models are powerful tools to describe dynamical st...
research
07/09/2021

The Bayesian Learning Rule

We show that many machine-learning algorithms are specific instances of ...
research
12/22/2015

Implementing a Bayes Filter in a Neural Circuit: The Case of Unknown Stimulus Dynamics

In order to interact intelligently with objects in the world, animals mu...
research
02/28/2023

Particle-based Online Bayesian Sampling

Online optimization has gained increasing interest due to its capability...

Please sign up or login with your details

Forgot password? Click here to reset