Projected Stein Variational Gradient Descent

02/09/2020
by   Peng Chen, et al.
14

The curse of dimensionality is a critical challenge in Bayesian inference for high dimensional parameters. In this work, we address this challenge by developing a projected Stein variational gradient descent (pSVGD) method, which projects the parameters into a subspace that is adaptively constructed using the gradient of the log-likelihood, and applies SVGD for the much lower-dimensional coefficients of the projection. We provide an upper bound for the projection error with respect to the posterior and demonstrate the accuracy (compared to SVGD) and scalability of pSVGD with respect to the number of parameters, samples, data points, and processor cores.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2020

Bayesian Neural Network via Stochastic Gradient Descent

The goal of bayesian approach used in variational inference is to minimi...
research
12/06/2022

Further analysis of multilevel Stein variational gradient descent with an application to the Bayesian inference of glacier ice models

Multilevel Stein variational gradient descent is a method for particle-b...
research
02/25/2020

Stein variational reduced basis Bayesian inversion

We propose and analyze a Stein variational reduced basis method (SVRB) t...
research
11/02/2020

Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities

We propose a high dimensional Bayesian inference framework for learning ...
research
02/07/2022

Grassmann Stein Variational Gradient Descent

Stein variational gradient descent (SVGD) is a deterministic particle in...
research
06/19/2015

Approximate Inference with the Variational Holder Bound

We introduce the Variational Holder (VH) bound as an alternative to Vari...
research
04/18/2023

High-dimensional Multi-class Classification with Presence-only Data

Classification with positive and unlabeled (PU) data frequently arises i...

Please sign up or login with your details

Forgot password? Click here to reset