Transporting Higher-Order Quadrature Rules: Quasi-Monte Carlo Points and Sparse Grids for Mixture Distributions

08/19/2023
by   Ilja Klebanov, et al.
0

Integration against, and hence sampling from, high-dimensional probability distributions is of essential importance in many application areas and has been an active research area for decades. One approach that has drawn increasing attention in recent years has been the generation of samples from a target distribution ℙ_tar using transport maps: if ℙ_tar = T_#ℙ_ref is the pushforward of an easily-sampled probability distribution ℙ_ref under the transport map T, then the application of T to ℙ_ref-distributed samples yields ℙ_tar-distributed samples. This paper proposes the application of transport maps not just to random samples, but also to quasi-Monte Carlo points, higher-order nets, and sparse grids in order for the transformed samples to inherit the original convergence rates that are often better than N^-1/2, N being the number of samples/quadrature nodes. Our main result is the derivation of an explicit transport map for the case that ℙ_tar is a mixture of simple distributions, e.g. a Gaussian mixture, in which case application of the transport map T requires the solution of an explicit ODE with closed-form right-hand side. Mixture distributions are of particular applicability and interest since many methods proceed by first approximating ℙ_tar by a mixture and then sampling from that mixture (often using importance reweighting). Hence, this paper allows for the sampling step to provide a better convergence rate than N^-1/2 for all such methods.

READ FULL TEXT
research
04/28/2023

Quasi-Monte Carlo methods for mixture distributions and approximated distributions via piecewise linear interpolation

We study numerical integration over bounded regions in ℝ^s, s≥1 with res...
research
01/12/2018

Deep Learning for Sampling from Arbitrary Probability Distributions

This paper proposes a fully connected neural network model to map sample...
research
12/26/2020

Population Quasi-Monte Carlo

Monte Carlo methods are widely used for approximating complicated, multi...
research
07/24/2019

Transport Monte Carlo

In Bayesian inference, transport map is a promising alternative to the c...
research
02/14/2023

Transport map unadjusted Langevin algorithms

Langevin dynamics are widely used in sampling high-dimensional, non-Gaus...
research
02/17/2020

Jittering Samples using a kd-Tree Stratification

Monte Carlo sampling techniques are used to estimate high-dimensional in...
research
07/29/2019

Blue-Noise Dithered QMC Hierarchical Russian Roulette

In order to efficiently sample specular-diffuse-glossy and glossy-diffus...

Please sign up or login with your details

Forgot password? Click here to reset