A Tutorial on Parametric Variational Inference

01/03/2023
by   Jens Sjölund, et al.
0

Variational inference uses optimization, rather than integration, to approximate the marginal likelihood, and thereby the posterior, in a Bayesian model. Thanks to advances in computational scalability made in the last decade, variational inference is now the preferred choice for many high-dimensional models and large datasets. This tutorial introduces variational inference from the parametric perspective that dominates these recent developments, in contrast to the mean-field perspective commonly found in other introductory texts.

READ FULL TEXT

page 3

page 5

page 7

research
11/15/2017

Advances in Variational Inference

Many modern unsupervised or semi-supervised machine learning algorithms ...
research
06/22/2012

Fast Variational Inference in the Conjugate Exponential Family

We present a general method for deriving collapsed variational inference...
research
10/19/2022

Rethinking Sharpness-Aware Minimization as Variational Inference

Sharpness-aware minimization (SAM) aims to improve the generalisation of...
research
04/16/2014

Structured Stochastic Variational Inference

Stochastic variational inference makes it possible to approximate poster...
research
06/11/2021

Posterior Temperature Optimization in Variational Inference

Cold posteriors have been reported to perform better in practice in the ...
research
10/04/2019

Streamlined Variational Inference for Linear Mixed Models with Crossed Random Effects

We derive streamlined mean field variational Bayes algorithms for fittin...
research
08/11/2020

Evidence bounds in singular models: probabilistic and variational perspectives

The marginal likelihood or evidence in Bayesian statistics contains an i...

Please sign up or login with your details

Forgot password? Click here to reset