Annealed Importance Sampling with q-Paths

12/14/2020
by   Rob Brekelmans, et al.
8

Annealed importance sampling (AIS) is the gold standard for estimating partition functions or marginal likelihoods, corresponding to importance sampling over a path of distributions between a tractable base and an unnormalized target. While AIS yields an unbiased estimator for any path, existing literature has been primarily limited to the geometric mixture or moment-averaged paths associated with the exponential family and KL divergence. We explore AIS using q-paths, which include the geometric path as a special case and are related to the homogeneous power mean, deformed exponential family, and α-divergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/01/2021

q-Paths: Generalizing the Geometric Annealing Path using Power Means

Many common machine learning methods involve the geometric annealing pat...
research
07/26/2017

Notes on optimal approximations for importance sampling

In this manuscript, we derive optimal conditions for building function a...
research
12/31/2020

Likelihood Ratio Exponential Families

The exponential family is well known in machine learning and statistical...
research
06/27/2023

Adaptive Annealed Importance Sampling with Constant Rate Progress

Annealed Importance Sampling (AIS) synthesizes weighted samples from an ...
research
09/27/2022

Optimization of Annealed Importance Sampling Hyperparameters

Annealed Importance Sampling (AIS) is a popular algorithm used to estima...
research
09/01/2020

Adaptive Path Sampling in Metastable Posterior Distributions

The normalizing constant plays an important role in Bayesian computation...
research
10/14/2019

A unified view of likelihood ratio and reparameterization gradients and an optimal importance sampling scheme

Reparameterization (RP) and likelihood ratio (LR) gradient estimators ar...

Please sign up or login with your details

Forgot password? Click here to reset