Parallel Sampling for Efficient High-dimensional Bayesian Network Structure Learning

02/19/2022
by   Zhigao Guo, et al.
0

Score-based algorithms that learn the structure of Bayesian networks can be used for both exact and approximate solutions. While approximate learning scales better with the number of variables, it can be computationally expensive in the presence of high dimensional data. This paper describes an approximate algorithm that performs parallel sampling on Candidate Parent Sets (CPSs), and can be viewed as an extension of MINOBS which is a state-of-the-art algorithm for structure learning from high dimensional data. The modified algorithm, which we call Parallel Sampling MINOBS (PS-MINOBS), constructs the graph by sampling CPSs for each variable. Sampling is performed in parallel under the assumption the distribution of CPSs is half-normal when ordered by Bayesian score for each variable. Sampling from a half-normal distribution ensures that the CPSs sampled are likely to be those which produce the higher scores. Empirical results show that, in most cases, the proposed algorithm discovers higher score structures than MINOBS when both algorithms are restricted to the same runtime limit.

READ FULL TEXT

page 6

page 16

research
06/08/2020

Approximate learning of high dimensional Bayesian network structures via pruning of Candidate Parent Sets

Score-based algorithms that learn Bayesian Network (BN) structures provi...
research
08/21/2021

A Sparse Structure Learning Algorithm for Bayesian Network Identification from Discrete High-Dimensional Data

This paper addresses the problem of learning a sparse structure Bayesian...
research
10/30/2019

Learning pairwise Markov network structures using correlation neighborhoods

Markov networks are widely studied and used throughout multivariate stat...
research
09/26/2013

Evaluating Anytime Algorithms for Learning Optimal Bayesian Networks

Exact algorithms for learning Bayesian networks guarantee to find provab...
research
04/22/2018

Learning Bayesian Networks from Big Data with Greedy Search: Computational Complexity and Efficient Implementation

Learning the structure of Bayesian networks from data is known to be a c...
research
01/04/2014

Concave Penalized Estimation of Sparse Gaussian Bayesian Networks

We develop a penalized likelihood estimation framework to estimate the s...
research
01/22/2019

Solving All Regression Models For Learning Gaussian Networks Using Givens Rotations

Score based learning (SBL) is a promising approach for learning Bayesian...

Please sign up or login with your details

Forgot password? Click here to reset