Stable Graphical Models

04/16/2014
by   Navodit Misra, et al.
0

Stable random variables are motivated by the central limit theorem for densities with (potentially) unbounded variance and can be thought of as natural generalizations of the Gaussian distribution to skewed and heavy-tailed phenomenon. In this paper, we introduce stable graphical (SG) models, a class of multivariate stable densities that can also be represented as Bayesian networks whose edges encode linear dependencies between random variables. One major hurdle to the extensive use of stable distributions is the lack of a closed-form analytical expression for their densities. This makes penalized maximum-likelihood based learning computationally demanding. We establish theoretically that the Bayesian information criterion (BIC) can asymptotically be reduced to the computationally more tractable minimum dispersion criterion (MDC) and develop StabLe, a structure learning algorithm based on MDC. We use simulated datasets for five benchmark network topologies to empirically demonstrate how StabLe improves upon ordinary least squares (OLS) regression. We also apply StabLe to microarray gene expression data for lymphoblastoid cells from 727 individuals belonging to eight global population groups. We establish that StabLe improves test set performance relative to OLS via ten-fold cross-validation. Finally, we develop SGEX, a method for quantifying differential expression of genes between different population groups.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2016

Structure Learning in Graphical Modeling

A graphical model is a statistical model that is associated to a graph w...
research
01/30/2013

On the Geometry of Bayesian Graphical Models with Hidden Variables

In this paper we investigate the geometry of the likelihood of the unkno...
research
08/09/2014

Robust Graphical Modeling with t-Distributions

Graphical Gaussian models have proven to be useful tools for exploring n...
research
06/18/2021

α-Stable convergence of heavy-tailed infinitely-wide neural networks

We consider infinitely-wide multi-layer perceptrons (MLPs) which are lim...
research
11/12/2018

Statistical Inference for Stable Distribution Using EM algorithm

The class of α-stable distributions with a wide range of applications in...
research
06/06/2019

Learning Gaussian Graphical Models with Ordered Weighted L1 Regularization

We address the task of identifying densely connected subsets of multivar...
research
04/07/2021

Approximate maximum likelihood estimators for linear regression with design matrix uncertainty

In this paper we consider regression problems subject to arbitrary noise...

Please sign up or login with your details

Forgot password? Click here to reset