Posterior Inference for Sparse Hierarchical Non-stationary Models

04/04/2018
by   Karla Monterrubio-Gómez, et al.
0

Gaussian processes are valuable tools for non-parametric modelling, where typically an assumption of stationarity is employed. While removing this assumption can improve prediction, fitting such models is challenging. In this work, hierarchical models are constructed based on Gaussian Markov random fields with stochastic spatially varying parameters. Importantly, this allows for non-stationarity while also addressing the computational burden through a sparse representation of the precision matrix. The prior field is chosen to be Matérn, and two hyperpriors, for the spatially varying parameters, are considered. One hyperprior is Ornstein-Uhlenbeck, formulated through an autoregressive AR(1) process. The other corresponds to the widely used squared exponential. Furthermore, all hyperparameters are treated as unknowns to achieve full uncertainty quantification. In this setting, efficient Markov chain Monte Carlo (MCMC) sampling is challenging due to the strong coupling a posteriori of the parameters and hyperparameters. We develop and compare three MCMC schemes, which are adaptive and therefore free of parameter tuning. An assessment of the ability of the methods to efficiently explore the posterior distribution and to account for non-stationarity is presented. Experiments in both simulated data and a real-world problem of cosmic radio noise are performed. We empirically consider posterior consistency of the estimates with respect to the discretisation scheme and explore the efficiency of the sampling methodologies under different settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2023

An MCMC Approach to Bayesian Image Analysis in Fourier Space

Bayesian methods are commonly applied to solve image analysis problems s...
research
11/11/2018

Langevin-gradient parallel tempering for Bayesian neural learning

Bayesian neural learning feature a rigorous approach to estimation and u...
research
07/30/2018

The Efficiency of Geometric Samplers for Exoplanet Transit Timing Variation Models

Transit timing variations (TTVs) are a valuable tool to determine the ma...
research
11/13/2017

Uncertainty quantification for radio interferometric imaging: I. proximal MCMC methods

Uncertainty quantification is a critical missing component in radio inte...
research
08/20/2021

Joint Estimation of Robin Coefficient and Domain Boundary for the Poisson Problem

We consider the problem of simultaneously inferring the heterogeneous co...
research
05/10/2019

Hyperparameter Estimation in Bayesian MAP Estimation: Parameterizations and Consistency

The Bayesian formulation of inverse problems is attractive for three pri...
research
03/29/2023

Computationally efficient sampling methods for sparsity promoting hierarchical Bayesian models

Bayesian hierarchical models have been demonstrated to provide efficient...

Please sign up or login with your details

Forgot password? Click here to reset