Efficient Structure Learning and Sampling of Bayesian Networks

03/21/2018
by   Jack Kuipers, et al.
0

Bayesian networks are probabilistic graphical models widely employed to understand dependencies in high dimensional data, and even to facilitate causal discovery. Learning the underlying network structure, which is encoded as a directed acyclic graph (DAG) is highly challenging mainly due to the vast number of possible networks. Efforts have focussed on two fronts: constraint based methods that perform conditional independence tests to exclude edges and score and search approaches which explore the DAG space with greedy or MCMC schemes. Here we synthesise these two fields in a novel hybrid method which reduces the complexity of MCMC approaches to that of a constraint based method. Individual steps in the MCMC scheme only require simple table lookups so that very long chains can be efficiently obtained. Furthermore, the scheme includes an iterative procedure to correct for errors from the conditional independence tests. The algorithm not only offers markedly superior performance to alternatives, but DAGs can also be sampled from the posterior distribution enabling full Bayesian modelling averaging for much larger Bayesian networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/02/2021

Bayesian structure learning and sampling of Bayesian networks with the R package BiDAG

The R package BiDAG implements Markov chain Monte Carlo (MCMC) methods f...
research
12/05/2022

A Comprehensively Improved Hybrid Algorithm for Learning Bayesian Networks: Multiple Compound Memory Erasing

Using a Bayesian network to analyze the causal relationship between node...
research
03/15/2018

Minimal I-MAP MCMC for Scalable Structure Discovery in Causal DAG Models

Learning a Bayesian network (BN) from data can be useful for decision-ma...
research
04/20/2015

Partition MCMC for inference on acyclic digraphs

Acyclic digraphs are the underlying representation of Bayesian networks,...
research
06/16/2013

Bayesian test of significance for conditional independence: The multinomial model

Conditional independence tests (CI tests) have received special attentio...
research
01/16/2013

On the Use of Skeletons when Learning in Bayesian Networks

In this paper, we present a heuristic operator which aims at simultaneou...
research
12/20/2022

Inversion of Bayesian Networks

Variational autoencoders and Helmholtz machines use a recognition networ...

Please sign up or login with your details

Forgot password? Click here to reset