A Unified Computational and Theoretical Framework for High-Dimensional Bayesian Additive Models

07/14/2020
by   Ray Bai, et al.
0

We introduce a general framework for estimation and variable selection in high-dimensional Bayesian generalized additive models where the response belongs to the overdispersed exponential family. Our framework subsumes popular models such as binomial regression, Poisson regression, Gaussian regression, and negative binomial regression, and encompasses both canonical and non-canonical link functions. Our method can be implemented with a highly efficient EM algorithm, allowing us to rapidly attain estimates of the significant functions while thresholding out insignificant ones. Under mild regularity conditions, we establish posterior contraction rates and model selection consistency when the number of covariates grows at nearly exponential rate with sample size. We illustrate our method on both synthetic and real data sets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/15/2019

Fast Algorithms and Theory for High-Dimensional Bayesian Varying Coefficient Models

Nonparametric varying coefficient (NVC) models are widely used for model...
research
01/30/2022

On the proof of posterior contraction for sparse generalized linear models with multivariate responses

In recent years, the literature on Bayesian high-dimensional variable se...
research
03/05/2019

Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models

We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimati...
research
06/13/2020

Model Based Screening Embedded Bayesian Variable Selection for Ultra-high Dimensional Settings

We develop a Bayesian variable selection method, called SVEN, based on a...
research
04/25/2023

Theory of Posterior Concentration for Generalized Bayesian Additive Regression Trees

Bayesian Additive Regression Trees (BART) are a powerful semiparametric ...
research
06/11/2020

Probabilistic Best Subset Selection by Gradient-Based Optimization

In high-dimensional statistics, variable selection is an optimization pr...
research
06/11/2020

Probabilistic Best Subset Selection via Gradient-Based Optimization

In high-dimensional statistics, variable selection is an optimization pr...

Please sign up or login with your details

Forgot password? Click here to reset