Dynamic sparsity on dynamic regression models

09/29/2020
by   Paloma W. Uribe, et al.
0

In the present work, we consider variable selection and shrinkage for the Gaussian dynamic linear regression within a Bayesian framework. In particular, we propose a novel method that allows for time-varying sparsity, based on an extension of spike-and-slab priors for dynamic models. This is done by assigning appropriate Markov switching priors for the time-varying coefficients' variances, extending the previous work of Ishwaran and Rao (2005). Furthermore, we investigate different priors, including the common Inverted gamma prior for the process variances, and other mixture prior distributions such as Gamma priors for both the spike and the slab, which leads to a mixture of Normal-Gammas priors (Griffin ad Brown, 2010) for the coefficients. In this sense, our prior can be view as a dynamic variable selection prior which induces either smoothness (through the slab) or shrinkage towards zero (through the spike) at each time point. The MCMC method used for posterior computation uses Markov latent variables that can assume binary regimes at each time point to generate the coefficients' variances. In that way, our model is a dynamic mixture model, thus, we could use the algorithm of Gerlach et al (2000) to generate the latent processes without conditioning on the states. Finally, our approach is exemplified through simulated examples and a real data application.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/18/2018

Comparing Spike and Slab Priors for Bayesian Variable Selection

An important task in building regression models is to decide which regre...
research
06/15/2021

A Horseshoe Pit mixture model for Bayesian screening with an application to light sheet fluorescence microscopy in brain imaging

Finding parsimonious models through variable selection is a fundamental ...
research
10/22/2020

A Normal-Gamma Dirichlet Process Mixture Model

We propose a Dirichlet process mixture (DPM) for prediction and cluster-...
research
09/29/2020

The Illusion of the Illusion of Sparsity: An exercise in prior sensitivity

The emergence of Big Data raises the question of how to model economic r...
research
02/27/2019

Bayesian Effect Selection in Structured Additive Distributional Regression Models

We propose a novel spike and slab prior specification with scaled beta p...
research
09/29/2018

Neuronized Priors for Bayesian Sparse Linear Regression

Although Bayesian variable selection procedures have been widely adopted...
research
04/28/2022

A robust Bayesian analysis of variable selection under prior ignorance

We propose a cautious Bayesian variable selection routine by investigati...

Please sign up or login with your details

Forgot password? Click here to reset