Convergence Analysis of a Collapsed Gibbs Sampler for Bayesian Vector Autoregressions

07/06/2019
by   Karl Oskar Ekvall, et al.
0

We propose a collapsed Gibbs sampler for Bayesian vector autoregressions with predictors, or exogenous variables, and study the proposed algorithm's convergence properties. The Markov chain generated by our algorithm converges to its stationary distribution at least as fast as those of competing (non-collapsed) Gibbs samplers and is shown to be geometrically ergodic regardless of whether the number of observations in the underlying vector autoregression is small or large in comparison to the order and dimension of it. We also give conditions for when the geometric ergodicity is asymptotically stable as the number of observations tends to infinity. Specifically, the geometric convergence rate is shown to be bounded away from unity asymptotically, either almost surely or with probability tending to one, depending on what is assumed about the data generating process. Our results are among the first of their kind for practically relevant Markov chain Monte Carlo algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2021

On the convergence rate of the "out-of-order" block Gibbs sampler

It is shown that a seemingly harmless reordering of the steps in a block...
research
03/10/2021

Dimension free convergence rates for Gibbs samplers for Bayesian linear mixed models

The emergence of big data has led to a growing interest in so-called con...
research
10/06/2015

Bayesian Markov Blanket Estimation

This paper considers a Bayesian view for estimating a sub-network in a M...
research
04/18/2020

Bayesian Parameter Identification for Jump Markov Linear Systems

This paper presents a Bayesian method for identification of jump Markov ...
research
01/11/2017

Fast mixing for Latent Dirichlet allocation

Markov chain Monte Carlo (MCMC) algorithms are ubiquitous in probability...
research
07/05/2021

Analyzing Relevance Vector Machines using a single penalty approach

Relevance vector machine (RVM) is a popular sparse Bayesian learning mod...
research
12/01/2018

Markov chain Monte Carlo Methods For Lattice Gaussian Sampling: Lattice Reduction and Decoding Optimization

Sampling from the lattice Gaussian distribution has emerged as an import...

Please sign up or login with your details

Forgot password? Click here to reset