Comparing Spike and Slab Priors for Bayesian Variable Selection

12/18/2018
by   Gertraud Malsiner-Walli, et al.
0

An important task in building regression models is to decide which regressors should be included in the final model. In a Bayesian approach, variable selection can be performed using mixture priors with a spike and a slab component for the effects subject to selection. As the spike is concentrated at zero, variable selection is based on the probability of assigning the corresponding regression effect to the slab component. These posterior inclusion probabilities can be determined by MCMC sampling. In this paper we compare the MCMC implementations for several spike and slab priors with regard to posterior inclusion probabilities and their sampling efficiency for simulated data. Further, we investigate posterior inclusion probabilities analytically for different slabs in two simple settings. Application of variable selection with spike and slab priors is illustrated on a data set of psychiatric patients where the goal is to identify covariates affecting metabolism.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2022

Bayesian high-dimensional covariate selection in non-linear mixed-effects models using the SAEM algorithm

High-dimensional data, with many more covariates than observations, such...
research
09/29/2020

Dynamic sparsity on dynamic regression models

In the present work, we consider variable selection and shrinkage for th...
research
04/28/2022

A robust Bayesian analysis of variable selection under prior ignorance

We propose a cautious Bayesian variable selection routine by investigati...
research
06/06/2018

ABC Variable Selection with Bayesian Forests

Few problems in statistics are as perplexing as variable selection in th...
research
05/31/2017

Bayesian l_0 Regularized Least Squares

Bayesian l_0-regularized least squares provides a variable selection tec...
research
11/08/2021

Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processes

Variable selection in Gaussian processes (GPs) is typically undertaken b...
research
07/01/2020

Variable Selection via Thompson Sampling

Thompson sampling is a heuristic algorithm for the multi-armed bandit pr...

Please sign up or login with your details

Forgot password? Click here to reset