DeepAI AI Chat
Log In Sign Up

Parallel Approaches to Accelerate Bayesian Decision Trees

01/22/2023
by   Efthyvoulos Drousiotis, et al.
University of Liverpool
0

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Existing work on Bayesian decision trees uses MCMC. Unfortunately, this can be slow, especially when considering large volumes of data. It is hard to parallelise the accept-reject component of the MCMC. None-the-less, we propose two methods for exploiting parallelism in the MCMC: in the first, we replace the MCMC with another numerical Bayesian approach, the Sequential Monte Carlo (SMC) sampler, which has the appealing property that it is an inherently parallel algorithm; in the second, we consider data partitioning. Both methods use multi-core processing with a HighPerformance Computing (HPC) resource. We test the two methods in various study settings to determine which method is the most beneficial for each test case. Experiments show that data partitioning has limited utility in the settings we consider and that the use of the SMC sampler can improve run-time (compared to the sequential implementation) by up to a factor of 343.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/24/2019

A Single SMC Sampler on MPI that Outperforms a Single MCMC Sampler

Markov Chain Monte Carlo (MCMC) is a well-established family of algorith...
07/26/2022

Single MCMC Chain Parallelisation on Decision Trees

Decision trees are highly famous in machine learning and usually acquire...
03/03/2013

Top-down particle filtering for Bayesian decision trees

Decision tree learning is a popular approach for classification and regr...
12/02/2016

Asynchronous Stochastic Gradient MCMC with Elastic Coupling

We consider parallel asynchronous Markov Chain Monte Carlo (MCMC) sampli...
03/28/2014

Accelerating MCMC via Parallel Predictive Prefetching

We present a general framework for accelerating a large class of widely ...
03/09/2020

MCMC Guided CNN Training and Segmentation for Pancreas Extraction

Efficient organ segmentation is the precondition of various quantitative...
11/26/2012

Bayesian learning of noisy Markov decision processes

We consider the inverse reinforcement learning problem, that is, the pro...