Fokker-Planck particle systems for Bayesian inference: Computational approaches

11/25/2019
by   Sebastian Reich, et al.
0

Bayesian inference can be embedded into an appropriately defined dynamics in the space of probability measures. In this paper, we take Brownian motion and its associated Fokker–Planck equation as a starting point for such embeddings and explore several interacting particle approximations. More specifically, we consider both deterministic and stochastic interacting particle systems and combine them with the idea of preconditioning by the empirical covariance matrix. In addition to leading to affine invariant formulations which asymptotically speed up convergence, preconditioning allows for gradient-free implementations in the spirit of the ensemble Kalman filter. While such gradient-free implementations have been demonstrated to work well for posterior measures that are nearly Gaussian, we extend their scope of applicability to multimodal measures by introducing localised gradient-free approximations. Numerical results demonstrate the effectiveness of the considered methodologies.

READ FULL TEXT

page 16

page 17

page 19

page 20

page 21

page 22

page 26

research
12/05/2019

Affine invariant interacting Langevin dynamics for Bayesian inference

We propose a computational method (with acronym ALDI) for sampling from ...
research
03/01/2019

Discrete gradients for computational Bayesian inference

In this paper, we exploit the gradient flow structure of continuous-time...
research
04/16/2021

Affine-invariant ensemble transform methods for logistic regression

We investigate the application of ensemble transform approaches to Bayes...
research
12/22/2022

Less interaction with forward models in Langevin dynamics

Ensemble methods have become ubiquitous for the solution of Bayesian inf...
research
09/09/2023

Affine Invariant Ensemble Transform Methods to Improve Predictive Uncertainty in ReLU Networks

We consider the problem of performing Bayesian inference for logistic re...
research
08/28/2019

Note on Interacting Langevin Diffusions: Gradient Structure and Ensemble Kalman Sampler by Garbuno-Inigo, Hoffmann, Li and Stuart

An interacting system of Langevin dynamics driven particles has been pro...
research
09/23/2022

Ensemble-based gradient inference for particle methods in optimization and sampling

We propose an approach based on function evaluations and Bayesian infere...

Please sign up or login with your details

Forgot password? Click here to reset