MCMC Algorithms for Posteriors on Matrix Spaces

08/07/2020
by   Alexandros Beskos, et al.
0

We study Markov chain Monte Carlo (MCMC) algorithms for target distributions defined on matrix spaces. Such an important sampling problem has yet to be analytically explored. We carry out a major step in covering this gap by developing the proper theoretical framework that allows for the identification of ergodicity properties of typical MCMC algorithms, relevant in such a context. Beyond the standard Random-Walk Metropolis (RWM) and preconditioned Crank–Nicolson (pCN), a contribution of this paper in the development of a novel algorithm, termed the `Mixed' pCN (MpCN). RWM and pCN are shown not to be geometrically ergodic for an important class of matrix distributions with heavy tails. In contrast, MpCN has very good empirical performance within this class. Geometric ergodicity for MpCN is not fully proven in this work, as some remaining drift conditions are quite challenging to obtain owing to the complexity of the state space. We do, however, make a lot of progress towards a proof, and show in detail the last steps left for future work. We illustrate the computational performance of the various algorithms through simulation studies, first for the trivial case of an Inverse-Wishart target, and then for a challenging model arising in financial statistics.

READ FULL TEXT

page 23

page 24

page 25

page 27

research
05/17/2020

Hamiltonian Assisted Metropolis Sampling

Various Markov chain Monte Carlo (MCMC) methods are studied to improve u...
research
08/30/2019

On the robustness of gradient-based MCMC algorithms

We analyse the tension between robustness and efficiency for Markov chai...
research
05/24/2022

Stereographic Markov Chain Monte Carlo

High dimensional distributions, especially those with heavy tails, are n...
research
11/17/2018

The Theory and Algorithm of Ergodic Inference

Approximate inference algorithm is one of the fundamental research field...
research
09/02/2019

Fourier transform MCMC, heavy tailed distributions and geometric ergodicity

Markov Chain Monte Carlo methods become increasingly popular in applied ...
research
10/14/2017

Mental Sampling in Multimodal Representations

Both resources in the natural environment and concepts in a semantic spa...

Please sign up or login with your details

Forgot password? Click here to reset