Data sparse multilevel covariance estimation in optimal complexity

01/27/2023
by   Jürgen Dölz, et al.
0

We consider the ℋ^2-formatted compression and computational estimation of covariance functions on a compact set in ℝ^d. The classical sample covariance or Monte Carlo estimator is prohibitively expensive for many practically relevant problems, where often approximation spaces with many degrees of freedom and many samples for the estimator are needed. In this article, we propose and analyze a data sparse multilevel sample covariance estimator, i.e., a multilevel Monte Carlo estimator. For this purpose, we generalize the notion of asymptotically smooth kernel functions to a Gevrey type class of kernels for which we derive new variable-order ℋ^2-approximation rates. These variable-order ℋ^2-approximations can be considered as a variant of hp-approximations. Our multilevel sample covariance estimator then uses an approximate multilevel hierarchy of variable-order ℋ^2-approximations to compress the sample covariances on each level. The non-nestedness of the different levels makes the reduction to the final estimator nontrivial and we present a suitable algorithm which can handle this task in linear complexity. This allows for a data sparse multilevel estimator of Gevrey covariance kernel functions in the best possible complexity for Monte Carlo type multilevel estimators, which is quadratic. Numerical examples which estimate covariance matrices with tens of billions of entries are presented.

READ FULL TEXT

page 16

page 18

page 23

research
05/25/2023

Quasi continuous level Monte Carlo

Continuous level Monte Carlo is an unbiased, continuous version of the c...
research
06/12/2023

Multivariate extensions of the Multilevel Best Linear Unbiased Estimator for ensemble-variational data assimilation

Multilevel estimators aim at reducing the variance of Monte Carlo statis...
research
03/07/2021

Multilevel approximation of Gaussian random fields: Covariance compression, estimation and spatial prediction

Centered Gaussian random fields (GRFs) indexed by compacta such as smoot...
research
09/07/2022

Multilevel Path Branching for Digital Options

We propose a new Monte Carlo-based estimator for digital options with as...
research
08/25/2021

A Multilevel Approach to Variance Reduction in the Stochastic Estimation of the Trace of a Matrix

The trace of a matrix function f(A), most notably of the matrix inverse,...
research
08/10/2022

Adaptive multilevel subset simulation with selective refinement

In this work we propose an adaptive multilevel version of subset simulat...
research
07/07/2021

Samplets: A new paradigm for data compression

In this article, we introduce the concept of samplets by transferring th...

Please sign up or login with your details

Forgot password? Click here to reset