Structure Learning from Related Data Sets with a Hierarchical Bayesian Score

08/04/2020
by   Laura Azzimonti, et al.
0

Score functions for learning the structure of Bayesian networks in the literature assume that data are a homogeneous set of observations; whereas it is often the case that they comprise different related, but not homogeneous, data sets collected in different ways. In this paper we propose a new Bayesian Dirichlet score, which we call Bayesian Hierarchical Dirichlet (BHD). The proposed score is based on a hierarchical model that pools information across data sets to learn a single encompassing network structure, while taking into account the differences in their probabilistic structures. We derive a closed-form expression for BHD using a variational approximation of the marginal likelihood and we study its performance using simulated data. We find that, when data comprise multiple related data sets, BHD outperforms the Bayesian Dirichlet equivalent uniform (BDeu) score in terms of reconstruction accuracy as measured by the Structural Hamming distance, and that it is as accurate as BDeu when data are homogeneous. Moreover, the estimated networks are sparser and therefore more interpretable than those obtained with BDeu, thanks to a lower number of false positive arcs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/08/2022

Using Mixed-Effect Models to Learn Bayesian Networks from Related Data Sets

We commonly assume that data are a homogeneous set of observations when ...
research
05/12/2016

An Empirical-Bayes Score for Discrete Bayesian Networks

Bayesian network structure learning is often performed in a Bayesian set...
research
05/23/2019

On Pruning for Score-Based Bayesian Network Structure Learning

Many algorithms for score-based Bayesian network structure learning (BNS...
research
09/05/2016

A max-cut approach to heterogeneity in cryo-electron microscopy

The field of cryo-electron microscopy has made astounding advancements i...
research
12/01/2018

Towards Gaussian Bayesian Network Fusion

Data sets are growing in complexity thanks to the increasing facilities ...
research
02/27/2013

An Evaluation of an Algorithm for Inductive Learning of Bayesian Belief Networks Usin

Bayesian learning of belief networks (BLN) is a method for automatically...
research
06/07/2017

On learning the structure of Bayesian Networks and submodular function maximization

Learning the structure of dependencies among multiple random variables i...

Please sign up or login with your details

Forgot password? Click here to reset