Sparse Gaussian chain graphs with the spike-and-slab LASSO: Algorithms and asymptotics

07/14/2022
by   Yunyi Shen, et al.
0

The Gaussian chain graph model simultaneously parametrizes (i) the direct effects of p predictors on q correlated outcomes and (ii) the residual partial covariance between pair of outcomes. We introduce a new method for fitting sparse Gaussian chain graph models with spike-and-slab LASSO (SSL) priors. We develop an Expectation-Conditional Maximization algorithm to obtain sparse estimates of the p × q matrix of direct effects and the q × q residual precision matrix. Our algorithm iteratively solves a sequence of penalized maximum likelihood problems with self-adaptive penalties that gradually filter out negligible regression coefficients and partial covariances. Because it adaptively penalizes model parameters, our method is seen to outperform fixed-penalty competitors on simulated data. We establish the posterior concentration rate for our model, buttressing our method's excellent empirical performance with strong theoretical guarantees. We use our method to reanalyze a dataset from a study of the effects of diet and residence type on the composition of the gut microbiome of elderly adults.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2022

On the posterior contraction of the multivariate spike-and-slab LASSO

We study the asymptotic properties of the multivariate spike-and-slab LA...
research
08/15/2013

High dimensional Sparse Gaussian Graphical Mixture Model

This paper considers the problem of networks reconstruction from heterog...
research
12/18/2017

Testing Sparsity-Inducing Penalties

It is well understood that many penalized maximum likelihood estimators ...
research
04/21/2021

Precision Matrix Estimation under the Horseshoe-like Prior-Penalty Dual

The problem of precision matrix estimation in a multivariate Gaussian mo...
research
05/24/2018

Dynamic Chain Graph Models for Ordinal Time Series Data

This paper introduces sparse dynamic chain graph models for network infe...
research
05/21/2022

Multi-task Learning for Gaussian Graphical Regressions with High Dimensional Covariates

Gaussian graphical regression is a powerful means that regresses the pre...
research
07/02/2021

The Effect of the Prior and the Experimental Design on the Inference of the Precision Matrix in Gaussian Chain Graph Models

Here, we investigate whether (and how) experimental design could aid in ...

Please sign up or login with your details

Forgot password? Click here to reset