Marginal likelihood and model selection for Gaussian latent tree and forest models

12/29/2014
by   Mathias Drton, et al.
0

Gaussian latent tree models, or more generally, Gaussian latent forest models have Fisher-information matrices that become singular along interesting submodels, namely, models that correspond to subforests. For these singularities, we compute the real log-canonical thresholds (also known as stochastic complexities or learning coefficients) that quantify the large-sample behavior of the marginal likelihood in Bayesian inference. This provides the information needed for a recently introduced generalization of the Bayesian information criterion. Our mathematical developments treat the general setting of Laplace integrals whose phase functions are sums of squared differences between monomials and constants. We clarify how in this case real log-canonical thresholds can be computed using polyhedral geometry, and we show how to apply the general theory to the Laplace integrals associated with Gaussian latent tree and forest models. In simulations and a data example, we demonstrate how the mathematical knowledge can be applied in model selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2019

Estimating Real Log Canonical Thresholds

Evaluation of the marginal likelihood plays an important role in model s...
research
03/14/2022

Asymptotic Behavior of Bayesian Generalization Error in Multinomial Mixtures

Multinomial mixtures are widely used in the information engineering fiel...
research
08/28/2019

On the overestimation of widely applicable Bayesian information criterion

A widely applicable Bayesian information criterion (Watanabe, 2013) is a...
research
04/22/2015

Rebuilding Factorized Information Criterion: Asymptotically Accurate Marginal Likelihood

Factorized information criterion (FIC) is a recently developed approxima...
research
06/26/2023

General adjoint-differentiated Laplace approximation

The hierarchical prior used in Latent Gaussian models (LGMs) induces a p...
research
04/27/2018

Efficiently Learning Nonstationary Gaussian Processes

Most real world phenomena such as sunlight distribution under a forest c...
research
04/27/2018

Efficiently Learning Nonstationary Gaussian Processes for Real World Impact

Most real world phenomena such as sunlight distribution under a forest c...

Please sign up or login with your details

Forgot password? Click here to reset