DeepAI
Log In Sign Up

Asymptotic Model Selection for Naive Bayesian Networks

12/12/2012
by   Dmitry Rusakov, et al.
0

We develop a closed form asymptotic formula to compute the marginal likelihood of data given a naive Bayesian network model with two hidden states and binary features. This formula deviates from the standard BIC score. Our work provides a concrete example that the BIC score is generally not valid for statistical models that belong to a stratified exponential family. This stands in contrast to linear and curved exponential families, where the BIC score has been proven to provide a correct approximation for the marginal likelihood.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/13/2013

Asymptotic Model Selection for Directed Networks with Hidden Variables

We extend the Bayesian Information Criterion (BIC), an asymptotic approx...
10/19/2012

Automated Analytic Asymptotic Evaluation of the Marginal Likelihood for Latent Models

We present and implement two algorithms for analytic asymptotic evaluati...
03/02/2019

An Empirical Bayes Method for Chi-Squared Data

In a thought-provoking paper, Efron (2011) investigated the merit and li...
01/10/2013

Classifier Learning with Supervised Marginal Likelihood

It has been argued that in supervised classification tasks, in practice ...
02/07/2019

Probably the Best Itemsets

One of the main current challenges in itemset mining is to discover a sm...
02/13/2013

Efficient Approximations for the Marginal Likelihood of Incomplete Data Given a Bayesian Network

We discuss Bayesian methods for learning Bayesian networks when data set...
03/15/2012

Learning networks determined by the ratio of prior and data

Recent reports have described that the equivalent sample size (ESS) in a...