DeepAI
Log In Sign Up

Annealed Importance Sampling with q-Paths

12/14/2020
by   Rob Brekelmans, et al.
8

Annealed importance sampling (AIS) is the gold standard for estimating partition functions or marginal likelihoods, corresponding to importance sampling over a path of distributions between a tractable base and an unnormalized target. While AIS yields an unbiased estimator for any path, existing literature has been primarily limited to the geometric mixture or moment-averaged paths associated with the exponential family and KL divergence. We explore AIS using q-paths, which include the geometric path as a special case and are related to the homogeneous power mean, deformed exponential family, and α-divergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/01/2021

q-Paths: Generalizing the Geometric Annealing Path using Power Means

Many common machine learning methods involve the geometric annealing pat...
07/26/2017

Notes on optimal approximations for importance sampling

In this manuscript, we derive optimal conditions for building function a...
12/31/2020

Likelihood Ratio Exponential Families

The exponential family is well known in machine learning and statistical...
04/18/2017

Stein Variational Adaptive Importance Sampling

We propose a novel adaptive importance sampling algorithm which incorpor...
09/27/2022

Optimization of Annealed Importance Sampling Hyperparameters

Annealed Importance Sampling (AIS) is a popular algorithm used to estima...
01/02/2022

Global convergence of optimized adaptive importance samplers

We analyze the optimized adaptive importance sampler (OAIS) for performi...
11/22/2021

Bootstrap Your Flow

Normalizing flows are flexible, parameterized distributions that can be ...