Black Box Variational Bayes Model Averaging

06/23/2021
by   Vojtech Kejzlar, et al.
0

For many decades now, Bayesian Model Averaging (BMA) has been a popular framework to systematically account for model uncertainty that arises in situations when multiple competing models are available to describe the same or similar physical process. The implementation of this framework, however, comes with multitude of practical challenges including posterior approximation via Markov Chain Monte Carlo and numerical integration. We present a Variational Bayes Inference approach to BMA as a viable alternative to the standard solutions which avoids many of the aforementioned pitfalls. The proposed method is 'black box' in the sense that it can be readily applied to many models with little to no model-specific derivation. We illustrate the utility of our variational approach on a suite of standard examples and discuss all the necessary implementation details. Fully documented Python code with all the examples is provided as well.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 12

05/23/2022

Quasi Black-Box Variational Inference with Natural Gradients for Bayesian Learning

We develop an optimization algorithm suitable for Bayesian learning in c...
07/03/2020

The FMRIB Variational Bayesian Inference Tutorial II: Stochastic Variational Bayes

Bayesian methods have proved powerful in many applications for the infer...
06/18/2020

Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and Optimization

Recent research has seen several advances relevant to black-box VI, but ...
05/26/2019

Variational Bayes under Model Misspecification

Variational Bayes (VB) is a scalable alternative to Markov chain Monte C...
11/19/2020

Variational Bayes Neural Network: Posterior Consistency, Classification Accuracy and Computational Challenges

Bayesian neural network models (BNN) have re-surged in recent years due ...
11/14/2018

Composing Modeling and Inference Operations with Probabilistic Program Combinators

Probabilistic programs with dynamic computation graphs can define measur...
11/18/2021

Implicit copula variational inference

Key to effective generic, or "black-box", variational inference is the s...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.