A Wall-time Minimizing Parallelization Strategy for Approximate Bayesian Computation

04/30/2023
by   Emad Alamoudi, et al.
0

Approximate Bayesian Computation (ABC) is a widely applicable and popular approach to estimating unknown parameters of mechanistic models. As ABC analyses are computationally expensive, parallelization on high-performance infrastructure is often necessary. However, the existing parallelization strategies leave resources unused at times and thus do not optimally leverage them yet. We present look-ahead scheduling, a wall-time minimizing parallelization strategy for ABC Sequential Monte Carlo algorithms, which utilizes all available resources at practically all times by proactive sampling for prospective tasks. Our strategy can be integrated in e.g. adaptive distance function and summary statistic selection schemes, which is essential in practice. Evaluation of the strategy on different problems and numbers of parallel cores reveals speed-ups of typically 10-20 the best established approach. Thus, the proposed strategy allows to substantially improve the cost and run-time efficiency of ABC methods on high-performance infrastructure.

READ FULL TEXT

page 5

page 8

page 11

page 27

page 30

research
11/13/2017

ABCpy: A High-Performance Computing Perspective to Approximate Bayesian Computation

ABCpy is a highly modular scientific library for Approximate Bayesian Co...
research
03/30/2020

Parallelization of Monte Carlo Tree Search in Continuous Domains

Monte Carlo Tree Search (MCTS) has proven to be capable of solving chall...
research
03/03/2022

Linear Run Time of Persistent Homology Computation with GPU Parallelization

Persistent homology is a crucial invariant that is used in many areas to...
research
04/16/2020

TensorOpt: Exploring the Tradeoffs in Distributed DNN Training with Auto-Parallelism

A good parallelization strategy can significantly improve the efficiency...
research
04/19/2018

Programming Parallel Dense Matrix Factorizations with Look-Ahead and OpenMP

We investigate a parallelization strategy for dense matrix factorization...
research
07/26/2021

A Parallel Boundary Element Method for the Electromagnetic Analysis of Large Structures With Lossy Conductors

In this paper, we propose an efficient parallelization strategy for boun...
research
03/24/2022

pyABC: Efficient and robust easy-to-use approximate Bayesian computation

The Python package pyABC provides a framework for approximate Bayesian c...

Please sign up or login with your details

Forgot password? Click here to reset