ABCpy: A High-Performance Computing Perspective to Approximate Bayesian Computation

11/13/2017
by   Ritabrata Dutta, et al.
0

ABCpy is a highly modular scientific library for Approximate Bayesian Computation (ABC) written in Python. The main contribution of this paper is to document a software engineering effort that enables domain scientists to easily apply ABC to their research without being ABC experts; using ABCpy they can easily run large parallel simulations without much knowledge about parallelization, even without much additional effort to parallelize their code. Further, ABCpy enables ABC experts to easily develop new inference schemes and evaluate them in a standardized environment and to extend the library with new algorithms. These benefits come mainly from the modularity of ABCpy. We give an overview of the design of ABCpy and provide a performance evaluation concentrating on parallelization. This points us towards the inherent imbalance in some of the ABC algorithms. We develop a dynamic scheduling MPI implementation to mitigate this issue and classify the algorithms according to their adaptability towards high-performance computing.

READ FULL TEXT
research
07/12/2021

giotto-ph: A Python Library for High-Performance Computation of Persistent Homology of Vietoris-Rips Filtrations

We introduce giotto-ph, a high-performance, open-source software package...
research
04/30/2023

A Wall-time Minimizing Parallelization Strategy for Approximate Bayesian Computation

Approximate Bayesian Computation (ABC) is a widely applicable and popula...
research
10/14/2019

BACKUS: Comprehensive High-Performance Research Software Engineering Approach for Simulations in Supercomputing Systems

High-Performance Computing (HPC) platforms enable scientific software to...
research
05/16/2023

MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformers

Automatic source-to-source parallelization of serial code for shared and...
research
11/08/2021

Performance Evaluation of Python Parallel Programming Models: Charm4Py and mpi4py

Python is rapidly becoming the lingua franca of machine learning and sci...
research
02/11/2016

High performance Python for direct numerical simulations of turbulent flows

Direct Numerical Simulations (DNS) of the Navier Stokes equations is an ...
research
04/30/2021

QDOT: Quantized Dot Product Kernel for Approximate High-Performance Computing

Approximate computing techniques have been successful in reducing comput...

Please sign up or login with your details

Forgot password? Click here to reset