Variance Analysis of Multiple Importance Sampling Schemes

07/09/2022
by   Rahul Mukerjee, et al.
0

Multiple importance sampling (MIS) is an increasingly used methodology where several proposal densities are used to approximate integrals, generally involving target probability density functions. The use of several proposals allows for a large variety of sampling and weighting schemes. Then, the practitioner must choose a given scheme, i.e., sampling mechanism and weighting function. A variance analysis has been proposed in Elvira et al (2019, Statistical Science 34, 129-155), showing the superiority of the balanced heuristic estimator with respect to other competing schemes in some scenarios. However, some of their results are valid only for two proposals. In this paper, we extend and generalize these results, providing novel proofs that allow to determine the variance relations among MIS schemes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/07/2022

Optimality in Noisy Importance Sampling

In this work, we analyze the noisy importance sampling (IS), i.e., IS wo...
research
03/28/2019

Generalizing the Balance Heuristic Estimator in Multiple Importance Sampling

In this paper, we propose a novel and generic family of multiple importa...
research
08/18/2019

Revisiting the balance heuristic for estimating normalising constants

Multiple importance sampling estimators are widely used for computing in...
research
10/17/2016

Black-box Importance Sampling

Importance sampling is widely used in machine learning and statistics, b...
research
03/27/2013

An Empirical Analysis of Likelihood-Weighting Simulation on a Large, Multiply-Connected Belief Network

We analyzed the convergence properties of likelihood- weighting algorith...
research
03/12/2018

Light Transport Simulation via Generalized Multiple Importance Sampling

Multiple importance sampling (MIS) is employed to reduce variance of est...
research
10/14/2019

A unified view of likelihood ratio and reparameterization gradients and an optimal importance sampling scheme

Reparameterization (RP) and likelihood ratio (LR) gradient estimators ar...

Please sign up or login with your details

Forgot password? Click here to reset