Scalable Physics-based Maximum Likelihood Estimation using Hierarchical Matrices

03/17/2023
by   Yian Chen, et al.
0

Physics-based covariance models provide a systematic way to construct covariance models that are consistent with the underlying physical laws in Gaussian process analysis. The unknown parameters in the covariance models can be estimated using maximum likelihood estimation, but direct construction of the covariance matrix and classical strategies of computing with it requires n physical model runs, n^2 storage complexity, and n^3 computational complexity. To address such challenges, we propose to approximate the discretized covariance function using hierarchical matrices. By utilizing randomized range sketching for individual off-diagonal blocks, the construction process of the hierarchical covariance approximation requires O(logn) physical model applications and the maximum likelihood computations require O(nlog^2n) effort per iteration. We propose a new approach to compute exactly the trace of products of hierarchical matrices which results in the expected Fischer information matrix being computable in O(nlog^2n) as well. The construction is totally matrix-free and the derivatives of the covariance matrix can then be approximated in the same hierarchical structure by differentiating the whole process. Numerical results are provided to demonstrate the effectiveness, accuracy, and efficiency of the proposed method for parameter estimations and uncertainty quantification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/09/2018

Scalable Gaussian Process Computations Using Hierarchical Matrices

We present a kernel-independent method that applies hierarchical matrice...
research
06/10/2022

Scalable Computations for Nonstationary Gaussian Processes

Nonstationary Gaussian process models can capture complex spatially vary...
research
10/07/2022

Maximum Likelihood-based Gridless DoA Estimation Using Structured Covariance Matrix Recovery and SBL with Grid Refinement

We consider the parametric data model employed in applications such as l...
research
12/07/2020

Likelihood Geometry of Correlation Models

Correlation matrices are standardized covariance matrices. They form an ...
research
09/15/2020

Interpolating the Trace of the Inverse of Matrix 𝐀 + t 𝐁

We develop heuristic interpolation methods for the function t ↦trace( (𝐀...
research
04/14/2021

Identification of unknown parameters and prediction with hierarchical matrices

Statistical analysis of massive datasets very often implies expensive li...

Please sign up or login with your details

Forgot password? Click here to reset