Bayesian Dynamic Fused LASSO

05/29/2019
by   Kaoru Irie, et al.
0

The new class of Markov processes is proposed to realize the flexible shrinkage effects for the dynamic models. The transition density of the new process consists of two penalty functions, similar to Bayesian fused LASSO in its functional form, that shrink the current state variable to its previous value and zero. The normalizing constant of the density, which is not ignorable in the posterior computation, is shown to be essentially the log-geometric mixture of double-exponential densities and treated as a part of the likelihood. The dynamic regression models with this new process used as a prior is conditionally Gaussian and linear in state variables, for which the posterior can be computed efficiently by utilizing the forward filtering and backward sampling in Gibbs sampler. The latent integer-valued parameter of the log-geometric distribution is understood as the amount of shrinkage to zero realized in the posterior and can be used to detect in which period the corresponding predictor becomes inactive. With the hyperparameters and observational variance estimated in Gibbs sampler, the new prior is compared with the standard double-exponential prior in the estimation of and prediction by the dynamic linear models for illustration. It is also applied to the time-varying vector autoregressive models for the US macroeconomic data and performs as an alternative of the dynamic model of variable selection type, such as the latent threshold models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2019

Triple the gamma – A unifying shrinkage prior for variance and variable selection in sparse state space and TVP models

Time-varying parameter (TVP) models are very flexible in capturing gradu...
research
08/27/2018

A Hybrid Alternative to Gibbs Sampling for Bayesian Latent Variable Models

Gibbs sampling is a widely popular Markov chain Monte Carlo algorithm wh...
research
01/02/2021

Geometric ergodicity of Gibbs samplers for the Horseshoe and its regularized variants

The Horseshoe is a widely used and popular continuous shrinkage prior fo...
research
03/16/2019

Fast Markov chain Monte Carlo for high dimensional Bayesian regression models with shrinkage priors

In the past decade, many Bayesian shrinkage models have been developed f...
research
09/17/2023

Gibbs Sampling using Anti-correlation Gaussian Data Augmentation, with Applications to L1-ball-type Models

L1-ball-type priors are a recent generalization of the spike-and-slab pr...
research
08/20/2023

Static and Dynamic BART for Rank-Order Data

Ranking lists are often provided at regular time intervals by one or mul...
research
05/18/2022

Power Transformations of Relative Count Data as a Shrinkage Problem

Here we show an application of our recently proposed information-geometr...

Please sign up or login with your details

Forgot password? Click here to reset