Properties of Bayesian Belief Network Learning Algorithms

02/27/2013
by   Remco R. Bouckaert, et al.
0

Bayesian belief network learning algorithms have three basic components: a measure of a network structure and a database, a search heuristic that chooses network structures to be considered, and a method of estimating the probability tables from the database. This paper contributes to all these three topics. The behavior of the Bayesian measure of Cooper and Herskovits and a minimum description length (MDL) measure are compared with respect to their properties for both limiting size and finite size databases. It is shown that the MDL measure has more desirable properties than the Bayesian measure when a distribution is to be learned. It is shown that selecting belief networks with certain minimallity properties is NP-hard. This result justifies the use of search heuristics instead of exact algorithms for choosing network structures to be considered. In some cases, a collection of belief networks can be represented by a single belief network which leads to a new kind of probability table estimation called smoothing. We argue that smoothing can be efficiently implemented by incorporating it in the search heuristic. Experimental results suggest that for learning probabilities of belief networks smoothing is helpful.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/27/2013

An Axiomatic Framework for Belief Updates

In the 1940's, a physicist named Cox provided the first formal justifica...
research
10/16/2012

Local Structure Discovery in Bayesian Networks

Learning a Bayesian network structure from data is an NP-hard problem an...
research
03/20/2013

A Bayesian Method for Constructing Bayesian Belief Networks from Databases

This paper presents a Bayesian method for constructing Bayesian belief n...
research
03/06/2013

GALGO: A Genetic ALGOrithm Decision Support Tool for Complex Uncertain Systems Modeled with Bayesian Belief Networks

Bayesian belief networks can be used to represent and to reason about co...
research
01/10/2011

Finding Consensus Bayesian Network Structures

Suppose that multiple experts (or learning algorithms) provide us with a...
research
03/27/2013

On Heuristics for Finding Loop Cutsets in Multiply-Connected Belief Networks

We introduce a new heuristic algorithm for the problem of finding minimu...
research
02/13/2013

A Structurally and Temporally Extended Bayesian Belief Network Model: Definitions, Properties, and Modeling Techniques

We developed the language of Modifiable Temporal Belief Networks (MTBNs)...

Please sign up or login with your details

Forgot password? Click here to reset