Correlation-based sparse inverse Cholesky factorization for fast Gaussian-process inference

12/29/2021
by   Myeongjong Kang, et al.
0

Gaussian processes are widely used as priors for unknown functions in statistics and machine learning. To achieve computationally feasible inference for large datasets, a popular approach is the Vecchia approximation, which is an ordered conditional approximation of the data vector that implies a sparse Cholesky factor of the precision matrix. The ordering and sparsity pattern are typically determined based on Euclidean distance of the inputs or locations corresponding to the data points. Here, we propose instead to use a correlation-based distance metric, which implicitly applies the Vecchia approximation in a suitable transformed input space. The correlation-based algorithm can be carried out in quasilinear time in the size of the dataset, and so it can be applied even for iterative inference on unknown parameters in the correlation structure. The Euclidean- and correlation-based Vecchia approximations are equivalent for strictly decreasing isotropic covariances, but the correlation-based approach has two advantages for more complex settings: It can result in more accurate approximations, and it offers a simple, automatic strategy that can be applied to any covariance, even when Euclidean distance is not applicable. We demonstrate these advantages in several settings, including anisotropic, nonstationary, multivariate, and spatio-temporal processes. We also illustrate our method on multivariate spatio-temporal temperature fields produced by a regional climate model.

READ FULL TEXT

page 11

page 12

page 14

page 16

page 18

page 20

research
07/19/2022

Scalable Spatio-Temporal Smoothing via Hierarchical Sparse Cholesky Decomposition

We propose an approximation to the forward-filter-backward-sampler (FFBS...
research
11/02/2021

Spatio-Temporal Variational Gaussian Processes

We introduce a scalable approach to Gaussian process inference that comb...
research
06/30/2020

Hierarchical sparse Cholesky decomposition with applications to high-dimensional spatio-temporal filtering

Spatial statistics often involves Cholesky decomposition of covariance m...
research
06/20/2023

Spatio-temporal DeepKriging for Interpolation and Probabilistic Forecasting

Gaussian processes (GP) and Kriging are widely used in traditional spati...
research
01/24/2022

Multivariate sensitivity analysis for a large-scale climate impact and adaptation model

We develop a new efficient methodology for Bayesian global sensitivity a...
research
10/13/2021

Ordered conditional approximation of Potts models

Potts models, which can be used to analyze dependent observations on a l...
research
07/21/2023

Sparse Cholesky factorization by greedy conditional selection

Dense kernel matrices resulting from pairwise evaluations of a kernel fu...

Please sign up or login with your details

Forgot password? Click here to reset