From Estimation to Sampling for Bayesian Linear Regression with Spike-and-Slab Prior

07/09/2023
by   Qijia Jiang, et al.
0

We consider Bayesian linear regression with sparsity-inducing prior and design efficient sampling algorithms leveraging posterior contraction properties. A quasi-likelihood with Gaussian spike-and-slab (that is favorable both statistically and computationally) is investigated and two algorithms based on Gibbs sampling and Stochastic Localization are analyzed, both under the same (quite natural) statistical assumptions that also enable valid inference on the sparse planted signal. The benefit of the Stochastic Localization sampler is particularly prominent for data matrix that is not well-designed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2020

Variable fusion for Bayesian linear regression via spike-and-slab priors

In linear regression models, a fusion of the coefficients is used to ide...
research
12/19/2019

Bayesian high-dimensional linear regression with generic spike-and-slab priors

Spike-and-slab priors are popular Bayesian solutions for high-dimensiona...
research
03/27/2018

Regularization and Computation with high-dimensional spike-and-slab posterior distributions

We consider the Bayesian analysis of a high-dimensional statistical mode...
research
06/14/2018

Efficient sampling for Gaussian linear regression with arbitrary priors

This paper develops a slice sampler for Bayesian linear regression model...
research
04/27/2017

Structured Sparse Modelling with Hierarchical GP

In this paper a new Bayesian model for sparse linear regression with a s...
research
10/29/2018

Prior-preconditioned conjugate gradient method for accelerated Gibbs sampling in "large n & large p" sparse Bayesian regression

In a modern observational study based on healthcare databases, the numbe...
research
09/09/2022

On the posterior contraction of the multivariate spike-and-slab LASSO

We study the asymptotic properties of the multivariate spike-and-slab LA...

Please sign up or login with your details

Forgot password? Click here to reset