Scalable Computations for Nonstationary Gaussian Processes

06/10/2022
by   Paul G. Beckman, et al.
0

Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with conventional dense linear algebra. In addition, derivative-free or even first-order optimization methods can be slow to converge when estimating many spatially varying parameters. We present here a computational framework that couples an algebraic block-diagonal plus low-rank covariance matrix approximation with stochastic trace estimation to facilitate the efficient use of second-order solvers for maximum likelihood estimation of Gaussian process models with many parameters. We demonstrate the effectiveness of these methods by simultaneously fitting 192 parameters in the popular nonstationary model of Paciorek and Schervish using 107,600 sea surface temperature anomaly measurements.

READ FULL TEXT

page 14

page 16

page 18

research
03/17/2023

Scalable Physics-based Maximum Likelihood Estimation using Hierarchical Matrices

Physics-based covariance models provide a systematic way to construct co...
research
04/24/2018

Tile Low-Rank Approximation of Large-Scale Maximum Likelihood Estimation on Manycore Architectures

Maximum likelihood estimation is an important statistical technique for ...
research
12/30/2020

Fast covariance parameter estimation of spatial Gaussian process models using neural networks

Gaussian processes (GPs) are a popular model for spatially referenced da...
research
04/24/2018

Parallel Approximation of the Maximum Likelihood Estimation for the Prediction of Large-Scale Geostatistics Simulations

Maximum likelihood estimation is an important statistical technique for ...
research
01/22/2020

Maximum Likelihood Estimation of Spatially Varying Coefficient Models for Large Data with an Application to Real Estate Price Prediction

In regression models for spatial data, it is often assumed that the marg...
research
04/24/2018

Composite Inference for Gaussian Processes

Large-scale Gaussian process models are becoming increasingly important ...
research
05/20/2019

Gaussian Process Learning via Fisher Scoring of Vecchia's Approximation

We derive a single pass algorithm for computing the gradient and Fisher ...

Please sign up or login with your details

Forgot password? Click here to reset