Approximate Shannon Sampling in Importance Sampling: Nearly Consistent Finite Particle Estimates

by   Alec Koppel, et al.

In Bayesian inference, we seek to compute information about random variables such as moments or quantiles on the basis of data and prior information. When the distribution of random variables is complicated, Monte Carlo (MC) sampling is usually required. Importance sampling is a standard MC tool for addressing this problem: one generates a collection of samples according to an importance distribution, computes their contribution to an unnormalized density, i.e., the importance weight, and then sums the result followed by normalization. This procedure is asymptotically consistent as the number of MC samples, and hence deltas (particles) that parameterize the density estimate, go to infinity. However, retaining in infnitely many particles is intractable. Thus, we propose a scheme for only keeping a nite representative subset of particles and their augmented importance weights that is nearly consistent.


page 1

page 2

page 3

page 4


Compressed Monte Carlo with application in particle filtering

Bayesian models have become very popular over the last years in several ...

Pushing the Limits of Importance Sampling through Iterative Moment Matching

The accuracy of an integral approximation via Monte Carlo sampling depen...

Adaptive importance sampling by kernel smoothing

A key determinant of the success of Monte Carlo simulation is the sampli...

Distributed SMC-PHD Fusion for Partial, Arithmetic Average Consensus

We propose an average consensus approach for distributed SMC-PHD (sequen...

Path Throughput Importance Weights

Many Monte Carlo light transport simulations use multiple importance sam...

Unrolling Particles: Unsupervised Learning of Sampling Distributions

Particle filtering is used to compute good nonlinear estimates of comple...

Histogram-Free Multicanonical Monte Carlo Sampling to Calculate the Density of States

We report a new multicanonical Monte Carlo algorithm to obtain the densi...