Massively Parallel Construction of Radix Tree Forests for the Efficient Sampling of Discrete Probability Distributions

01/02/2019
by   Nikolaus Binder, et al.
0

We compare different methods for sampling from discrete probability distributions and introduce a new algorithm which is especially efficient on massively parallel processors, such as GPUs. The scheme preserves the distribution properties of the input sequence, exposes constant time complexity on the average, and significantly lowers the average number of operations for certain distributions when sampling is performed in a parallel algorithm that requires synchronization afterwards. Avoiding load balancing issues of naïve approaches, a very efficient massively parallel construction algorithm for the required auxiliary data structure is complemented.

READ FULL TEXT
research
10/17/2016

Efficient Random Sampling - Parallel, Vectorized, Cache-Efficient, and Online

We consider the problem of sampling n numbers from the range {1,...,N} w...
research
02/01/2023

DEIM vs. leverage scores for time-parallel construction of problem-adapted basis functions

To tackle heterogeneous time-dependent problems, an algorithm that const...
research
09/30/2017

An Efficient Load Balancing Method for Tree Algorithms

Nowadays, multiprocessing is mainstream with exponentially increasing nu...
research
09/11/2018

Maximally Consistent Sampling and the Jaccard Index of Probability Distributions

We introduce simple, efficient algorithms for computing a MinHash of a p...
research
03/08/2020

The Fast Loaded Dice Roller: A Near-Optimal Exact Sampler for Discrete Probability Distributions

This paper introduces a new algorithm for the fundamental problem of gen...
research
12/05/2018

Low-Complexity Data-Parallel Earth Mover's Distance Approximations

The Earth Mover's Distance (EMD) is a state-of-the art metric for compar...
research
07/17/2020

Parameter estimation for Gibbs distributions

We consider Gibbs distributions, which are families of probability distr...

Please sign up or login with your details

Forgot password? Click here to reset