DeepAI AI Chat
Log In Sign Up

Efficient Approximations for the Marginal Likelihood of Incomplete Data Given a Bayesian Network

by   David Maxwell Chickering, et al.

We discuss Bayesian methods for learning Bayesian networks when data sets are incomplete. In particular, we examine asymptotic approximations for the marginal likelihood of incomplete data given a Bayesian network. We consider the Laplace approximation and the less accurate but more efficient BIC/MDL approximation. We also consider approximations proposed by Draper (1993) and Cheeseman and Stutz (1995). These approximations are as efficient as BIC/MDL, but their accuracy has not been studied in any depth. We compare the accuracy of these approximations under the assumption that the Laplace approximation is the most accurate. In experiments using synthetic data generated from discrete naive-Bayes models having a hidden root node, we find that the CS measure is the most accurate.


page 1

page 2

page 3

page 4


Asymptotic Model Selection for Directed Networks with Hidden Variables

We extend the Bayesian Information Criterion (BIC), an asymptotic approx...

Automated Analytic Asymptotic Evaluation of the Marginal Likelihood for Latent Models

We present and implement two algorithms for analytic asymptotic evaluati...

Laplace and Saddlepoint Approximations in High Dimensions

We examine the behaviour of the Laplace and saddlepoint approximations i...

Asymptotic Model Selection for Naive Bayesian Networks

We develop a closed form asymptotic formula to compute the marginal like...

Bayesian inference with tmbstan for a state-space model with VAR(1) state equation

When using R package tmbstan for Bayesian inference, the built-in featur...

A recursive algorithm for an efficient and accurate computation of incomplete Bessel functions

In a previous work, we developed an algorithm for the computation of inc...

Identifiability and Consistency of Bayesian Network Structure Learning from Incomplete Data

Bayesian network (BN) structure learning from complete data has been ext...