An Improved Admissible Heuristic for Learning Optimal Bayesian Networks

10/16/2012
by   Changhe Yuan, et al.
0

Recently two search algorithms, A* and breadth-first branch and bound (BFBnB), were developed based on a simple admissible heuristic for learning Bayesian network structures that optimize a scoring function. The heuristic represents a relaxation of the learning problem such that each variable chooses optimal parents independently. As a result, the heuristic may contain many directed cycles and result in a loose bound. This paper introduces an improved admissible heuristic that tries to avoid directed cycles within small groups of variables. A sparse representation is also introduced to store only the unique optimal parent choices. Empirical results show that the new techniques significantly improved the efficiency and scalability of A* and BFBnB on most of datasets tested in this paper.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 8

page 9

page 10

research
01/16/2013

A Branch-and-Bound Algorithm for MDL Learning Bayesian Networks

This paper extends the work in [Suzuki, 1996] and presents an efficient ...
research
09/26/2013

Evaluating Anytime Algorithms for Learning Optimal Bayesian Networks

Exact algorithms for learning Bayesian networks guarantee to find provab...
research
03/13/2013

A Probabilistic Network of Predicates

Bayesian networks are directed acyclic graphs representing independence ...
research
02/06/2013

Cost-Sharing in Bayesian Knowledge Bases

Bayesian knowledge bases (BKBs) are a generalization of Bayes networks a...
research
02/14/2012

Improving the Scalability of Optimal Bayesian Network Learning with External-Memory Frontier Breadth-First Branch and Bound Search

Previous work has shown that the problem of learning the optimal structu...
research
01/16/2013

On the Use of Skeletons when Learning in Bayesian Networks

In this paper, we present a heuristic operator which aims at simultaneou...
research
01/10/2011

Finding Consensus Bayesian Network Structures

Suppose that multiple experts (or learning algorithms) provide us with a...

Please sign up or login with your details

Forgot password? Click here to reset