Note on Interacting Langevin Diffusions: Gradient Structure and Ensemble Kalman Sampler by Garbuno-Inigo, Hoffmann, Li and Stuart

08/28/2019
by   Nikolas Nüsken, et al.
0

An interacting system of Langevin dynamics driven particles has been proposed for sampling from a given posterior density by Garbuno-Inigo, Hoffmann, Li and Stuart in Interacting Langevin Diffusions: Gradient Structure and Ensemble Kalman Sampler (arXiv:1903:08866v2). The proposed formulation is primarily studied from a formal mean-field limit perspective, while the theoretical behaviour under a finite particle size is left as an open problem. In this note we demonstrate that the particle-based covariance interaction term requires a non-trivial correction. We also show that the corrected dynamics samples exactly from the desired posterior provided that the empirical covariance matrix of the particle system remains non-singular and the posterior log-density satisfies the standard Bakry-Emery criterion.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2023

Affine Invariant Ensemble Transform Methods to Improve Predictive Uncertainty in ReLU Networks

We consider the problem of performing Bayesian inference for logistic re...
research
06/01/2020

Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimation

Fokker-Planck equations are extensively employed in various scientific f...
research
12/05/2019

Affine invariant interacting Langevin dynamics for Bayesian inference

We propose a computational method (with acronym ALDI) for sampling from ...
research
11/25/2019

Fokker-Planck particle systems for Bayesian inference: Computational approaches

Bayesian inference can be embedded into an appropriately defined dynamic...
research
12/22/2022

Less interaction with forward models in Langevin dynamics

Ensemble methods have become ubiquitous for the solution of Bayesian inf...
research
04/27/2021

Complete Deterministic Dynamics and Spectral Decomposition of the Ensemble Kalman Inversion

The Ensemble Kalman inversion (EKI), proposed by Iglesias et al. for the...
research
02/20/2022

Interacting Contour Stochastic Gradient Langevin Dynamics

We propose an interacting contour stochastic gradient Langevin dynamics ...

Please sign up or login with your details

Forgot password? Click here to reset