Adaptive importance sampling by kernel smoothing

03/20/2019
by   Bernard Delyon, et al.
0

A key determinant of the success of Monte Carlo simulation is the sampling policy, the sequence of distribution used to generate the particles, and allowing the sampling policy to evolve adaptively during the algorithm provides considerable improvement in practice. The issues related to the adaptive choice of the sampling policy are addressed from a functional estimation point of view. adaptive importance sampling approach is revisited The considered approach consists of modelling the sampling policy as a mixture distribution between a flexible kernel density estimate, based on the whole set of available particles, and a naive heavy tail density. When the share of samples generated according to the naive density goes to zero but not too quickly, two results are established. Uniform convergence rates are derived for the sampling policy estimate. A central limit theorem is obtained for the resulting integral estimates. The fact that the asymptotic variance is the same as the variance of an "oracle" procedure, in which the sampling policy is chosen as the optimal one, illustrates the benefits of the proposed approach.

READ FULL TEXT
research
10/29/2021

Adaptive Importance Sampling meets Mirror Descent: a Bias-variance tradeoff

Adaptive importance sampling is a widely spread Monte Carlo technique th...
research
04/07/2016

An Adaptive Resample-Move Algorithm for Estimating Normalizing Constants

The estimation of normalizing constants is a fundamental step in probabi...
research
06/04/2018

Efficiency of adaptive importance sampling

The sampling policy of stage t, formally expressed as a probability dens...
research
09/23/2019

Approximate Shannon Sampling in Importance Sampling: Nearly Consistent Finite Particle Estimates

In Bayesian inference, we seek to compute information about random varia...
research
06/04/2018

Asymptotic optimality of adaptive importance sampling

Adaptive importance sampling (AIS) uses past samples to update the sampl...
research
03/02/2017

In Search of an Entity Resolution OASIS: Optimal Asymptotic Sequential Importance Sampling

Entity resolution (ER) presents unique challenges for evaluation methodo...
research
01/12/2019

Importance sampling for thermally induced switching and non-switching probabilities in spin-torque magnetic nanodevices

Spin-transfer torque magnetoresistive random access memory is a potentia...

Please sign up or login with your details

Forgot password? Click here to reset