Variationally Inferred Sampling Through a Refined Bound for Probabilistic Programs

08/26/2019
by   Víctor Gallego, et al.
14

A framework to boost efficiency of Bayesian inference in probabilistic programs is introduced by embedding a sampler inside a variational posterior approximation, which we call the refined variational approximation. Its strength lies both in ease of implementation and in automatically tuning the sampler parameters to speed up mixing time. Several strategies to approximate the evidence lower bound (ELBO) computation are introduced, including a rewriting of the ELBO objective. A specialization towards state-space models is proposed. Experimental evidence of its efficient performance is shown by solving an influence diagram in a high-dimensional space using a conditional variational autoencoder (cVAE) as a deep Bayes classifier; an unconditional VAE on density estimation tasks; and state-space models for time-series data.

READ FULL TEXT
research
11/20/2018

Black-Box Autoregressive Density Estimation for State-Space Models

State-space models (SSMs) provide a flexible framework for modelling tim...
research
10/20/2022

Efficient variational approximations for state space models

Variational Bayes methods are a scalable estimation approach for many co...
research
10/02/2019

Scalable approximate inference for state space models with normalising flows

By exploiting mini-batch stochastic gradient optimisation, variational i...
research
07/29/2020

Unnormalized Variational Bayes

We unify empirical Bayes and variational Bayes for approximating unnorma...
research
10/26/2021

Online Variational Filtering and Parameter Learning

We present a variational method for online state estimation and paramete...
research
09/29/2021

An efficient pseudo marginal method for state space models

Pseudo Marginal Metropolis-Hastings (PMMH) is a general approach to carr...
research
03/21/2018

Adaptive Sequential MCMC for Combined State and Parameter Estimation

In the case of a linear state space model, we implement an MCMC sampler ...

Please sign up or login with your details

Forgot password? Click here to reset