DeepAI AI Chat
Log In Sign Up

IID Sampling from Intractable Distributions

by   Sourabh Bhattacharya, et al.

We propose a novel methodology for drawing iid realizations from any target distribution on the Euclidean space with arbitrary dimension. No assumption of compact support is necessary for the validity of our theory and method. Our idea is to construct an appropriate infinite sequence of concentric closed ellipsoids, represent the target distribution as an infinite mixture on the central ellipsoid and the ellipsoidal annuli, and to construct efficient perfect samplers for the mixture components. In contrast with most of the existing works on perfect sampling, ours is not only a theoretically valid method, it is practically applicable to all target distributions on any dimensional Euclidean space and very much amenable to parallel computation. We validate the practicality and usefulness of our methodology by generating 10000 iid realizations from the standard distributions such as normal, Student's t with 5 degrees of freedom and Cauchy, for dimensions d = 1, 5, 10, 50, 100, as well as from a 50-dimensional mixture normal distribution. The implementation time in all the cases are very reasonable, and often less than a minute in our parallel implementation. The results turned out to be highly accurate. We also apply our method to draw 10000 iid realizations from the posterior distributions associated with the well-known Challenger data, a Salmonella data and the 160-dimensional challenging spatial example of the radionuclide count data on Rongelap Island. Again, we are able to obtain quite encouraging results with very reasonable computing time.


page 13

page 15

page 17

page 18

page 19

page 26

page 27

page 28


IID Sampling from Intractable Multimodal and Variable-Dimensional Distributions

Bhattacharya (2021b) has introduced a novel methodology for generating i...

Design of Hamiltonian Monte Carlo for perfect simulation of general continuous distributions

Hamiltonian Monte Carlo (HMC) is an efficient method of simulating smoot...

IID Sampling from Posterior Dirichlet Process Mixtures

The influence of Dirichlet process mixture is ubiquitous in the Bayesian...

Mixture representations of noncentral distributions

With any symmetric distribution μ on the real line we may associate a pa...

Finite mixture models are typically inconsistent for the number of components

Scientists and engineers are often interested in learning the number of ...

Gaussbock: Fast parallel-iterative cosmological parameter estimation with Bayesian nonparametrics

We present and apply Gaussbock, a new embarrassingly parallel iterative ...

On the numerical approximation of Blaschke-Santaló diagrams using Centroidal Voronoi Tessellations

Identifying Blaschke-Santaló diagrams is an important topic that essenti...