Asymptotic Model Selection for Naive Bayesian Networks

12/12/2012
by   Dmitry Rusakov, et al.
0

We develop a closed form asymptotic formula to compute the marginal likelihood of data given a naive Bayesian network model with two hidden states and binary features. This formula deviates from the standard BIC score. Our work provides a concrete example that the BIC score is generally not valid for statistical models that belong to a stratified exponential family. This stands in contrast to linear and curved exponential families, where the BIC score has been proven to provide a correct approximation for the marginal likelihood.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2013

Asymptotic Model Selection for Directed Networks with Hidden Variables

We extend the Bayesian Information Criterion (BIC), an asymptotic approx...
research
10/19/2012

Automated Analytic Asymptotic Evaluation of the Marginal Likelihood for Latent Models

We present and implement two algorithms for analytic asymptotic evaluati...
research
01/23/2013

On Supervised Selection of Bayesian Networks

Given a set of possible models (e.g., Bayesian network structures) and a...
research
01/10/2013

Classifier Learning with Supervised Marginal Likelihood

It has been argued that in supervised classification tasks, in practice ...
research
02/13/2013

Efficient Approximations for the Marginal Likelihood of Incomplete Data Given a Bayesian Network

We discuss Bayesian methods for learning Bayesian networks when data set...
research
03/15/2012

Learning networks determined by the ratio of prior and data

Recent reports have described that the equivalent sample size (ESS) in a...
research
10/29/2020

Staged trees are curved exponential families

Staged tree models are a discrete generalization of Bayesian networks. W...

Please sign up or login with your details

Forgot password? Click here to reset