Group Spike and Slab Variational Bayes

09/19/2023
by   Michael Komodromos, et al.
0

In this manuscript we introduce Group Spike-and-slab Variational Bayes (GSVB), a scalable method for group sparse regression. We constrcut a fast co-ordinate ascent variational inference algorithm for several model families including: the Gaussian, Binomail and Poisson. Through extensive numerical studies we demonstrate that GSVB provides state-of-the-art performance, offering a computationally inexpensive substitute to MCMC, whilst performing comparably or better than existing MAP methods. Additionally, we analyze three real world datasets wherein we highlight the practical utility of our method, demonstrating that GSVB provides parsimonious models with excellent predictive performance, variable selection and uncertainty quantification.

READ FULL TEXT

page 16

page 18

page 35

research
11/21/2022

A Variational Inference method for Bayesian variable selection

Variable selection is a classic problem in statistics. In this paper, we...
research
12/19/2021

Variational Bayes for high-dimensional proportional hazards models with applications to gene expression variable selection

We propose a variational Bayesian proportional hazards model for predict...
research
03/05/2019

Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models

We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimati...
research
11/15/2020

Efficient Variational Inference for Sparse Deep Learning with Theoretical Guarantee

Sparse deep learning aims to address the challenge of huge storage consu...
research
11/08/2021

Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processes

Variable selection in Gaussian processes (GPs) is typically undertaken b...
research
06/16/2017

Adversarial Variational Inference for Tweedie Compound Poisson Models

Tweedie Compound Poisson models are heavily used for modelling non-negat...
research
03/10/2019

Streamlined Variational Inference for Higher Level Group-Specific Curve Models

A two-level group-specific curve model is such that the mean response of...

Please sign up or login with your details

Forgot password? Click here to reset