A Metropolized adaptive subspace algorithm for high-dimensional Bayesian variable selection

05/03/2021
by   Christian Staerk, et al.
0

A simple and efficient adaptive Markov Chain Monte Carlo (MCMC) method, called the Metropolized Adaptive Subspace (MAdaSub) algorithm, is proposed for sampling from high-dimensional posterior model distributions in Bayesian variable selection. The MAdaSub algorithm is based on an independent Metropolis-Hastings sampler, where the individual proposal probabilities of the explanatory variables are updated after each iteration using a form of Bayesian adaptive learning, in a way that they finally converge to the respective covariates' posterior inclusion probabilities. We prove the ergodicity of the algorithm and present a parallel version of MAdaSub with an adaptation scheme for the proposal probabilities based on the combination of information from multiple chains. The effectiveness of the algorithm is demonstrated via various simulated and real data examples, including a high-dimensional problem with more than 20,000 covariates.

READ FULL TEXT

page 17

page 40

research
10/22/2021

Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable Selection

We introduce a framework for efficient Markov Chain Monte Carlo (MCMC) a...
research
01/01/2021

A Two Stage Adaptive Metropolis Algorithm

We propose a new sampling algorithm combining two quite powerful ideas i...
research
12/06/2017

Targeted Random Projection for Prediction from High-Dimensional Features

We consider the problem of computationally-efficient prediction from hig...
research
09/29/2021

Adaptive Bayesian Sum of Trees Model for Covariate Dependent Spectral Analysis

This article introduces a flexible and adaptive nonparametric method for...
research
01/30/2014

Sparse Bayesian Unsupervised Learning

This paper is about variable selection, clustering and estimation in an ...
research
08/01/2023

Adaptive MCMC for Bayesian variable selection in generalised linear models and survival models

Developing an efficient computational scheme for high-dimensional Bayesi...
research
03/11/2020

Lifted samplers for partially ordered discrete state-spaces

A technique called lifting is employed in practice for avoiding that the...

Please sign up or login with your details

Forgot password? Click here to reset