Particle Mean Field Variational Bayes

03/24/2023
by   Minh-Ngoc Tran, et al.
0

The Mean Field Variational Bayes (MFVB) method is one of the most computationally efficient techniques for Bayesian inference. However, its use has been restricted to models with conjugate priors or those that require analytical calculations. This paper proposes a novel particle-based MFVB approach that greatly expands the applicability of the MFVB method. We establish the theoretical basis of the new method by leveraging the connection between Wasserstein gradient flows and Langevin diffusion dynamics, and demonstrate the effectiveness of this approach using Bayesian logistic regression, stochastic volatility, and deep neural networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/19/2012

Variational Inference in Nonconjugate Models

Mean-field variational methods are widely used for approximate posterior...
research
10/22/2020

Spike and slab variational Bayes for high dimensional logistic regression

Variational Bayes (VB) is a popular scalable alternative to Markov chain...
research
05/13/2013

Mean field variational Bayesian inference for support vector machine classification

A mean field variational Bayes approach to support vector machines (SVMs...
research
04/16/2021

Affine-invariant ensemble transform methods for logistic regression

We investigate the application of ensemble transform approaches to Bayes...
research
11/09/2019

Recent developments in controlled crowd dynamics

We survey recent results on controlled particle systems. The control asp...
research
05/31/2013

Expectation-maximization for logistic regression

We present a family of expectation-maximization (EM) algorithms for bina...

Please sign up or login with your details

Forgot password? Click here to reset