Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates

04/20/2020
by   Xuan Cao, et al.
0

We consider the joint sparse estimation of regression coefficients and the covariance matrix for covariates in a high-dimensional regression model, where the predictors are both relevant to a response variable of interest and functionally related to one another via a Gaussian directed acyclic graph (DAG) model. Gaussian DAG models introduce sparsity in the Cholesky factor of the inverse covariance matrix, and the sparsity pattern in turn corresponds to specific conditional independence assumptions on the underlying predictors. A variety of methods have been developed in recent years for Bayesian inference in identifying such network-structured predictors in regression setting, yet crucial sparsity selection properties for these models have not been thoroughly investigated. In this paper, we consider a hierarchical model with spike and slab priors on the regression coefficients and a flexible and general class of DAG-Wishart distributions with multiple shape parameters on the Cholesky factors of the inverse covariance matrix. Under mild regularity assumptions, we establish the joint selection consistency for both the variable and the underlying DAG of the covariates when the dimension of predictors is allowed to grow much larger than the sample size. We demonstrate that our method outperforms existing methods in selecting network-structured predictors in several simulation settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2022

Consistent and scalable Bayesian joint variable and graph selection for disease diagnosis leveraging functional brain network

We consider the joint inference of regression coefficients and the inver...
research
03/08/2019

Consistent Bayesian Sparsity Selection for High-dimensional Gaussian DAG Models with Multiplicative and Beta-mixture Priors

Estimation of the covariance matrix for high-dimensional multivariate da...
research
06/19/2013

Joint estimation of sparse multivariate regression and conditional graphical models

Multivariate regression model is a natural generalization of the classic...
research
07/07/2021

Bounded support in linear random coefficient models: Identification and variable selection

We consider linear random coefficient regression models, where the regre...
research
10/28/2019

Power analysis of knockoff filters for correlated designs

The knockoff filter introduced by Barber and Candès 2016 is an elegant f...
research
05/23/2023

High-dimensional Posterior Consistency in Multi-response Regression models with Non-informative Priors for Error Covariance Matrix

The Inverse-Wishart (IW) distribution is a standard and popular choice o...
research
12/10/2018

Capturing Between-Tasks Covariance and Similarities Using Multivariate Linear Mixed Models

We consider the problem of predicting several response variables using t...

Please sign up or login with your details

Forgot password? Click here to reset