Approximate Shannon Sampling in Importance Sampling: Nearly Consistent Finite Particle Estimates

09/23/2019
by   Alec Koppel, et al.
0

In Bayesian inference, we seek to compute information about random variables such as moments or quantiles on the basis of data and prior information. When the distribution of random variables is complicated, Monte Carlo (MC) sampling is usually required. Importance sampling is a standard MC tool for addressing this problem: one generates a collection of samples according to an importance distribution, computes their contribution to an unnormalized density, i.e., the importance weight, and then sums the result followed by normalization. This procedure is asymptotically consistent as the number of MC samples, and hence deltas (particles) that parameterize the density estimate, go to infinity. However, retaining in infnitely many particles is intractable. Thus, we propose a scheme for only keeping a nite representative subset of particles and their augmented importance weights that is nearly consistent.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/18/2021

Compressed Monte Carlo with application in particle filtering

Bayesian models have become very popular over the last years in several ...
06/20/2019

Pushing the Limits of Importance Sampling through Iterative Moment Matching

The accuracy of an integral approximation via Monte Carlo sampling depen...
03/20/2019

Adaptive importance sampling by kernel smoothing

A key determinant of the success of Monte Carlo simulation is the sampli...
12/17/2017

Distributed SMC-PHD Fusion for Partial, Arithmetic Average Consensus

We propose an average consensus approach for distributed SMC-PHD (sequen...
06/04/2018

Path Throughput Importance Weights

Many Monte Carlo light transport simulations use multiple importance sam...
10/06/2021

Unrolling Particles: Unsupervised Learning of Sampling Distributions

Particle filtering is used to compute good nonlinear estimates of comple...
11/15/2018

Histogram-Free Multicanonical Monte Carlo Sampling to Calculate the Density of States

We report a new multicanonical Monte Carlo algorithm to obtain the densi...