Robust Bayesian Model Selection for Variable Clustering with the Gaussian Graphical Model

06/15/2018
by   Daniel Andrade, et al.
0

Variable clustering is important for explanatory analysis. However, only few dedicated methods for variable clustering with the Gaussian graphical model have been proposed. Even more severe, small insignificant partial correlations due to noise can dramatically change the clustering result when evaluating for example with the Bayesian Information Criteria (BIC). In this work, we try to address this issue by proposing a Bayesian model that accounts for negligible small, but not necessarily zero, partial correlations. Based on our model, we propose to evaluate a variable clustering result using the marginal likelihood. To address the intractable calculation of the marginal likelihood, we propose two solutions: one based on a variational approximation, and another based on MCMC. Experiments on simulated data shows that the proposed method is similarly accurate as BIC in the no noise setting, but considerably more accurate when there are noisy partial correlations. Furthermore, on real data the proposed method provides clustering results that are intuitively sensible, which is not always the case when using BIC or its extensions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2021

Identifying Gene-environment interactions with robust marginal Bayesian variable selection

In high-throughput genetics studies, an important aim is to identify gen...
research
04/20/2021

Partial Correlation Graphical LASSO

Standard likelihood penalties to learn Gaussian graphical models are bas...
research
06/14/2017

The ratio of normalizing constants for Bayesian graphical Gaussian model selection

The ratio of normalizing constants for the G-Wishart distribution, for t...
research
03/20/2018

Momentum-Space Renormalization Group Transformation in Bayesian Image Modeling by Gaussian Graphical Model

A new Bayesian modeling method is proposed by combining the maximization...
research
01/16/2013

A Two-round Variant of EM for Gaussian Mixtures

Given a set of possible models (e.g., Bayesian network structures) and a...
research
04/07/2019

An IRT-based Model for Omitted and Not-reached Items

Missingness is a common occurrence in educational assessment and psychol...
research
03/08/2017

Exact Dimensionality Selection for Bayesian PCA

We present a Bayesian model selection approach to estimate the intrinsic...

Please sign up or login with your details

Forgot password? Click here to reset