An Improved Admissible Heuristic for Learning Optimal Bayesian Networks

10/16/2012
by   Changhe Yuan, et al.
0

Recently two search algorithms, A* and breadth-first branch and bound (BFBnB), were developed based on a simple admissible heuristic for learning Bayesian network structures that optimize a scoring function. The heuristic represents a relaxation of the learning problem such that each variable chooses optimal parents independently. As a result, the heuristic may contain many directed cycles and result in a loose bound. This paper introduces an improved admissible heuristic that tries to avoid directed cycles within small groups of variables. A sparse representation is also introduced to store only the unique optimal parent choices. Empirical results show that the new techniques significantly improved the efficiency and scalability of A* and BFBnB on most of datasets tested in this paper.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 3

page 4

page 5

page 6

page 8

page 9

page 10

01/16/2013

A Branch-and-Bound Algorithm for MDL Learning Bayesian Networks

This paper extends the work in [Suzuki, 1996] and presents an efficient ...
09/26/2013

Evaluating Anytime Algorithms for Learning Optimal Bayesian Networks

Exact algorithms for learning Bayesian networks guarantee to find provab...
03/13/2013

A Probabilistic Network of Predicates

Bayesian networks are directed acyclic graphs representing independence ...
02/06/2013

Cost-Sharing in Bayesian Knowledge Bases

Bayesian knowledge bases (BKBs) are a generalization of Bayes networks a...
02/14/2012

Improving the Scalability of Optimal Bayesian Network Learning with External-Memory Frontier Breadth-First Branch and Bound Search

Previous work has shown that the problem of learning the optimal structu...
01/16/2013

On the Use of Skeletons when Learning in Bayesian Networks

In this paper, we present a heuristic operator which aims at simultaneou...
01/10/2011

Finding Consensus Bayesian Network Structures

Suppose that multiple experts (or learning algorithms) provide us with a...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.