Variance Analysis of Multiple Importance Sampling Schemes

07/09/2022
by   Rahul Mukerjee, et al.
0

Multiple importance sampling (MIS) is an increasingly used methodology where several proposal densities are used to approximate integrals, generally involving target probability density functions. The use of several proposals allows for a large variety of sampling and weighting schemes. Then, the practitioner must choose a given scheme, i.e., sampling mechanism and weighting function. A variance analysis has been proposed in Elvira et al (2019, Statistical Science 34, 129-155), showing the superiority of the balanced heuristic estimator with respect to other competing schemes in some scenarios. However, some of their results are valid only for two proposals. In this paper, we extend and generalize these results, providing novel proofs that allow to determine the variance relations among MIS schemes.

READ FULL TEXT

page 1

page 2

page 3

page 4

01/07/2022

Optimality in Noisy Importance Sampling

In this work, we analyze the noisy importance sampling (IS), i.e., IS wo...
03/28/2019

Generalizing the Balance Heuristic Estimator in Multiple Importance Sampling

In this paper, we propose a novel and generic family of multiple importa...
08/18/2019

Revisiting the balance heuristic for estimating normalising constants

Multiple importance sampling estimators are widely used for computing in...
10/17/2016

Black-box Importance Sampling

Importance sampling is widely used in machine learning and statistics, b...
03/27/2013

An Empirical Analysis of Likelihood-Weighting Simulation on a Large, Multiply-Connected Belief Network

We analyzed the convergence properties of likelihood- weighting algorith...
10/14/2019

A unified view of likelihood ratio and reparameterization gradients and an optimal importance sampling scheme

Reparameterization (RP) and likelihood ratio (LR) gradient estimators ar...
06/20/2022

Learning Optimal Flows for Non-Equilibrium Importance Sampling

Many applications in computational sciences and statistical inference re...