Benchpress: a scalable and platform-independent workflow for benchmarking structure learning algorithms for graphical models

07/08/2021
by   Felix L. Rios, et al.
0

Describing the relationship between the variables in a study domain and modelling the data generating mechanism is a fundamental problem in many empirical sciences. Probabilistic graphical models are one common approach to tackle the problem. Learning the graphical structure is computationally challenging and a fervent area of current research with a plethora of algorithms being developed. To facilitate the benchmarking of different methods, we present a novel automated workflow, called benchpress for producing scalable, reproducible, and platform-independent benchmarks of structure learning algorithms for probabilistic graphical models. Benchpress is interfaced via a simple JSON-file, which makes it accessible for all users, while the code is designed in a fully modular fashion to enable researchers to contribute additional methodologies. Benchpress currently provides an interface to a large number of state-of-the-art algorithms from libraries such as BDgraph, BiDAG, bnlearn, GOBNILP, pcalg, r.blip, scikit-learn, TETRAD, and trilearn as well as a variety of methods for data generating models and performance evaluation. Alongside user-defined models and randomly generated datasets, the software tool also includes a number of standard datasets and graphical models from the literature, which may be included in a benchmarking workflow. We demonstrate the applicability of this workflow for learning Bayesian networks in four typical data scenarios. The source code and documentation is publicly available from http://github.com/felixleopoldo/benchpress.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/08/2019

Empirical Bayesian Learning in AR Graphical Models

We address the problem of learning graphical models which correspond to ...
research
06/01/2012

OpenGM: A C++ Library for Discrete Graphical Models

OpenGM is a C++ template library for defining discrete graphical models ...
research
09/29/2015

Semantics, Representations and Grammars for Deep Learning

Deep learning is currently the subject of intensive study. However, fund...
research
07/10/2018

Customised Structural Elicitation

Established methods for structural elicitation typically rely on code mo...
research
08/10/2011

A survey on independence-based Markov networks learning

This work reports the most relevant technical aspects in the problem of ...
research
04/04/2017

AMIDST: a Java Toolbox for Scalable Probabilistic Machine Learning

The AMIDST Toolbox is a software for scalable probabilistic machine lear...
research
08/19/2021

Reproducible radiomics through automated machine learning validated on twelve clinical applications

Radiomics uses quantitative medical imaging features to predict clinical...

Please sign up or login with your details

Forgot password? Click here to reset