Low-Cost Bayesian Inference for Additive Approximate Gaussian Process

12/31/2017
by   Pulong Ma, et al.
0

Gaussian process models have been widely used in spatial/spatio-temporal statistics and uncertainty quantification. The use of a separable covariance function in these cases has computational advantages, but it ignores the potential interaction among space/time and input/output variables. In this paper we propose an additive covariance function approximation to allow for the interaction among variables in the resulting Gaussian process. The proposed method approximates the covariance function through two distinct components: a computational-complexity-reduction covariance function and a separable covariance function. The first component captures the large scale non-separable variation while the second component captures the separable variation. As shown in this paper, the new covariance structure can greatly improve the predictive accuracy but loses the computational advantages of its two distinct components. To alleviate this computational difficulty, we develop a fully conditional Markov chain Monte Carlo algorithm based on the hierarchical representation of the model. The computational cost of this algorithm is equivalent to the additive cost from the two components. The computational and inferential benefits of this new additive approximation approach are demonstrated with synthetic examples and Eastern U.S. ozone data.

READ FULL TEXT

page 16

page 24

research
04/17/2016

Regularizing Solutions to the MEG Inverse Problem Using Space-Time Separable Covariance Functions

In magnetoencephalography (MEG) the conventional approach to source reco...
research
11/30/2017

Nonseparable Gaussian Stochastic Process: A Unified View and Computational Strategy

Gaussian stochastic process (GaSP) has been widely used as a prior over ...
research
05/20/2019

Gaussian Process Learning via Fisher Scoring of Vecchia's Approximation

We derive a single pass algorithm for computing the gradient and Fisher ...
research
04/29/2020

Sparse Cholesky factorization by Kullback-Leibler minimization

We propose to compute a sparse approximate inverse Cholesky factor L of ...
research
08/01/2011

Adaptive Gaussian Predictive Process Approximation

We address the issue of knots selection for Gaussian predictive process ...
research
02/05/2023

On Kronecker Separability of Multiway Covariance

Multiway data analysis is aimed at inferring patterns from data represen...

Please sign up or login with your details

Forgot password? Click here to reset