Patterns of Scalable Bayesian Inference

02/16/2016
by   Elaine Angelino, et al.
0

Datasets are growing not just in size but in complexity, creating a demand for rich models and quantification of uncertainty. Bayesian methods are an excellent fit for this demand, but scaling Bayesian inference is a challenge. In response to this challenge, there has been considerable recent work based on varying assumptions about model structure, underlying computational resources, and the importance of asymptotic correctness. As a result, there is a zoo of ideas with few clear overarching principles. In this paper, we seek to identify unifying principles, patterns, and intuitions for scaling Bayesian inference. We review existing work on utilizing modern computing resources with both MCMC and variational approximation techniques. From this taxonomy of ideas, we characterize the general principles that have proven successful for designing scalable inference procedures and comment on the path forward.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2018

Scalable Bayesian Learning for State Space Models using Variational Inference with SMC Samplers

We present a scalable approach to performing approximate fully Bayesian ...
research
05/20/2016

Coresets for Scalable Bayesian Logistic Regression

The use of Bayesian methods in large-scale data settings is attractive b...
research
04/11/2020

Scaling Bayesian inference of mixed multinomial logit models to very large datasets

Variational inference methods have been shown to lead to significant imp...
research
04/28/2022

Bernstein - von Mises theorem and misspecified models: a review

This is a review of asymptotic and non-asymptotic behaviour of Bayesian ...
research
08/12/2018

An Asymptotically Efficient Metropolis-Hastings Sampler for Bayesian Inference in Large-Scale Educational Measuremen

This paper discusses a Metropolis-Hastings algorithm developed by Marsma...
research
04/14/2022

A new avenue for Bayesian inference with INLA

Integrated Nested Laplace Approximations (INLA) has been a successful ap...
research
11/03/2020

Hints and Principles for Computer System Design

This new long version of my 1983 paper suggests the goals you might have...

Please sign up or login with your details

Forgot password? Click here to reset