Fast Algorithms and Theory for High-Dimensional Bayesian Varying Coefficient Models

07/15/2019
by   Ray Bai, et al.
0

Nonparametric varying coefficient (NVC) models are widely used for modeling time-varying effects on responses that are measured repeatedly. In this paper, we introduce the nonparametric varying coefficient spike-and-slab lasso (NVC-SSL) for Bayesian estimation and variable selection in NVC models. The NVC-SSL simultaneously estimates the functionals of the significant time-varying covariates while thresholding out insignificant ones. Our model can be implemented using a highly efficient expectation-maximization (EM) algorithm, thus avoiding the computational burden of Markov chain Monte Carlo (MCMC) in high dimensions. In contrast to frequentist NVC models, hardly anything is known about the large-sample properties for Bayesian NVC models. In this paper, we take a step towards addressing this longstanding gap between methodology and theory by deriving posterior contraction rates under the NVC-SSL model when the number of covariates grows at nearly exponential rate with sample size. Finally, we illustrate our methodology through simulation studies and data analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/05/2019

Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models

We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimati...
research
07/14/2020

A Unified Computational and Theoretical Framework for High-Dimensional Bayesian Additive Models

We introduce a general framework for estimation and variable selection i...
research
09/13/2020

Bayesian modelling of time-varying conditional heteroscedasticity

Conditional heteroscedastic (CH) models are routinely used to analyze fi...
research
02/27/2021

Time-Varying Coefficient Model Estimation Through Radial Basis Functions

In this paper we estimate the dynamic parameters of a time-varying coeff...
research
10/24/2020

Nearly Optimal Variational Inference for High Dimensional Regression with Shrinkage Priors

We propose a variational Bayesian (VB) procedure for high-dimensional li...
research
03/17/2023

Inference of Grouped Time-Varying Network Vector Autoregression Models

This paper considers statistical inference of time-varying network vecto...

Please sign up or login with your details

Forgot password? Click here to reset