Model Based Screening Embedded Bayesian Variable Selection for Ultra-high Dimensional Settings

06/13/2020
by   Dongjin Li, et al.
0

We develop a Bayesian variable selection method, called SVEN, based on a hierarchical Gaussian linear model with priors placed on the regression coefficients as well as on the model space. Sparsity is achieved by using degenerate spike priors on inactive variables, whereas Gaussian slab priors are placed on the coefficients for the important predictors making the posterior probability of a model available in explicit form (up to a normalizing constant). The strong model selection consistency is shown to be attained when the number of predictors grows nearly exponentially with the sample size and even when the norm of mean effects solely due to the unimportant variables diverge, which is a novel attractive feature. An appealing byproduct of SVEN is the construction of novel model weight adjusted prediction intervals. Embedding a unique model based screening and using fast Cholesky updates, SVEN produces a highly scalable computational framework to explore gigantic model spaces, rapidly identify the regions of high posterior probabilities and make fast inference and prediction. A temperature schedule guided by our model selection consistency derivations is used to further mitigate multimodal posterior distributions. The performance of SVEN is demonstrated through a number of simulation experiments and a real data example from a genome wide association study with over half a million markers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/21/2021

Bayesian iterative screening in ultra-high dimensional settings

Variable selection in ultra-high dimensional linear regression is often ...
research
04/28/2022

A robust Bayesian analysis of variable selection under prior ignorance

We propose a cautious Bayesian variable selection routine by investigati...
research
09/06/2021

Screening the Discrepancy Function of a Computer Model

Screening traditionally refers to the problem of detecting active inputs...
research
09/27/2017

Multi-way Interacting Regression via Factorization Machines

We propose a Bayesian regression method that accounts for multi-way inte...
research
05/31/2017

Bayesian l_0 Regularized Least Squares

Bayesian l_0-regularized least squares provides a variable selection tec...
research
07/14/2020

A Unified Computational and Theoretical Framework for High-Dimensional Bayesian Additive Models

We introduce a general framework for estimation and variable selection i...
research
03/30/2017

On Bayesian Exponentially Embedded Family for Model Order Selection

In this paper, we derive a Bayesian model order selection rule by using ...

Please sign up or login with your details

Forgot password? Click here to reset