Variance Analysis of Multiple Importance Sampling Schemes

by   Rahul Mukerjee, et al.

Multiple importance sampling (MIS) is an increasingly used methodology where several proposal densities are used to approximate integrals, generally involving target probability density functions. The use of several proposals allows for a large variety of sampling and weighting schemes. Then, the practitioner must choose a given scheme, i.e., sampling mechanism and weighting function. A variance analysis has been proposed in Elvira et al (2019, Statistical Science 34, 129-155), showing the superiority of the balanced heuristic estimator with respect to other competing schemes in some scenarios. However, some of their results are valid only for two proposals. In this paper, we extend and generalize these results, providing novel proofs that allow to determine the variance relations among MIS schemes.


page 1

page 2

page 3

page 4


Optimality in Noisy Importance Sampling

In this work, we analyze the noisy importance sampling (IS), i.e., IS wo...

Generalizing the Balance Heuristic Estimator in Multiple Importance Sampling

In this paper, we propose a novel and generic family of multiple importa...

Revisiting the balance heuristic for estimating normalising constants

Multiple importance sampling estimators are widely used for computing in...

Black-box Importance Sampling

Importance sampling is widely used in machine learning and statistics, b...

An Empirical Analysis of Likelihood-Weighting Simulation on a Large, Multiply-Connected Belief Network

We analyzed the convergence properties of likelihood- weighting algorith...

A unified view of likelihood ratio and reparameterization gradients and an optimal importance sampling scheme

Reparameterization (RP) and likelihood ratio (LR) gradient estimators ar...

Learning Optimal Flows for Non-Equilibrium Importance Sampling

Many applications in computational sciences and statistical inference re...