Correcting the Laplace Method with Variational Bayes

11/25/2021
by   Janet Van Niekerk, et al.
0

Approximate inference methods like the Laplace method, Laplace approximations and variational methods, amongst others, are popular methods when exact inference is not feasible due to the complexity of the model or the abundance of data. In this paper we propose a hybrid approximate method namely Low-Rank Variational Bayes correction (VBC), that uses the Laplace method and subsequently a Variational Bayes correction to the posterior mean. The cost is essentially that of the Laplace method which ensures scalability of the method. We illustrate the method and its advantages with simulated and real data, on small and large scale.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2015

Linear Response Methods for Accurate Covariance Estimates from Mean Field Variational Bayes

Mean field variational Bayes (MFVB) is a popular posterior approximation...
research
02/27/2013

Laplace's Method Approximations for Probabilistic Inference in Belief Networks with Continuous Variables

Laplace's method, a family of asymptotic methods used to approximate int...
research
08/18/2020

Fast Approximate Bayesian Contextual Cold Start Learning (FAB-COST)

Cold-start is a notoriously difficult problem which can occur in recomme...
research
09/07/2013

Variational Bayes Approximations for Clustering via Mixtures of Normal Inverse Gaussian Distributions

Parameter estimation for model-based clustering using a finite mixture o...
research
07/07/2022

Challenges and Pitfalls of Bayesian Unlearning

Machine unlearning refers to the task of removing a subset of training d...
research
04/27/2023

Variational Bayes Made Easy

Variational Bayes is a popular method for approximate inference but its ...
research
04/01/2018

Continuous Record Laplace-based Inference about the Break Date in Structural Change Models

Building upon the continuous record asymptotic framework recently introd...

Please sign up or login with your details

Forgot password? Click here to reset