Density Estimation by Monte Carlo and Quasi-Monte Carlo

by   Pierre L'Ecuyer, et al.

Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods include histograms and kernel density estimators. In this review paper, we are interested instead in the situation where the observations are generated by Monte Carlo simulation from a model. Then, one can take advantage of variance reduction methods such as stratification, conditional Monte Carlo, and randomized quasi-Monte Carlo (RQMC), and obtain a more accurate density estimator than with standard Monte Carlo for a given computing budget. We discuss several ways of doing this, proposed in recent papers, with a focus on methods that exploit RQMC. A first idea is to directly combine RQMC with a standard kernel density estimator. Another one is to adapt a simulation-based derivative estimation method such as smoothed perturbation analysis or the likelihood ratio method to obtain a continuous estimator of the cdf, whose derivative is an unbiased estimator of the density. This can then be combined with RQMC. We summarize recent theoretical results with these approaches and give numerical illustrations of how they improve the convergence of the mean square integrated error.



There are no comments yet.


page 1

page 2

page 3

page 4


Monte Carlo and Quasi-Monte Carlo Density Estimation via Conditioning

Estimating the unknown density from which a given independent sample ori...

Quasi-Monte Carlo-Based Conditional Malliavin Method for Continuous-Time Asian Option Greeks

Although many methods for computing the Greeks of discrete-time Asian op...

Histogram-Free Multicanonical Monte Carlo Sampling to Calculate the Density of States

We report a new multicanonical Monte Carlo algorithm to obtain the densi...

New Tricks for Estimating Gradients of Expectations

We derive a family of Monte Carlo estimators for gradients of expectatio...

Density estimation by Randomized Quasi-Monte Carlo

We consider the problem of estimating the density of a random variable X...

Sensitivity estimation of conditional value at risk using randomized quasi-Monte Carlo

Conditional value at risk (CVaR) is a popular measure for quantifying po...

Probabilistic Constrained Optimization on Flow Networks

Uncertainty often plays an important role in dynamic flow problems. In t...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.