Learning Bayesian Networks: The Combination of Knowledge and Statistical Data

02/27/2013
by   David Heckerman, et al.
0

We describe algorithms for learning Bayesian networks from a combination of user knowledge and statistical data. The algorithms have two components: a scoring metric and a search procedure. The scoring metric takes a network structure, statistical data, and a user's prior knowledge, and returns a score proportional to the posterior probability of the network structure given the data. The search procedure generates networks for evaluation by the scoring metric. Our contributions are threefold. First, we identify two important properties of metrics, which we call event equivalence and parameter modularity. These properties have been mostly ignored, but when combined, greatly simplify the encoding of a user's prior knowledge. In particular, a user can express her knowledge-for the most part-as a single prior Bayesian network for the domain. Second, we describe local search and annealing algorithms to be used in conjunction with scoring metrics. In the special case where each node has at most one parent, we show that heuristic search can be replaced with a polynomial algorithm to identify the networks with the highest score. Third, we describe a methodology for evaluating Bayesian-network learning algorithms. We apply this approach to a comparison of metrics and search procedures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2013

Learning Gaussian Networks

We describe algorithms for learning Bayesian networks from a combination...
research
02/06/2013

A Bayesian Approach to Learning Bayesian Networks with Local Structure

Recently several researchers have investigated techniques for using data...
research
09/26/2013

SparsityBoost: A New Scoring Function for Learning Bayesian Network Structure

We give a new consistent scoring function for structure learning of Baye...
research
04/28/2019

Optimizing regularized Cholesky score for order-based learning of Bayesian networks

Bayesian networks are a class of popular graphical models that encode ca...
research
08/09/2014

Scoring and Searching over Bayesian Networks with Causal and Associative Priors

A significant theoretical advantage of search-and-score methods for lear...
research
01/16/2013

On the Use of Skeletons when Learning in Bayesian Networks

In this paper, we present a heuristic operator which aims at simultaneou...
research
12/12/2012

A Bayesian Network Scoring Metric That Is Based On Globally Uniform Parameter Priors

We introduce a new Bayesian network (BN) scoring metric called the Globa...

Please sign up or login with your details

Forgot password? Click here to reset