Analysis of stochastic probing methods for estimating the trace of functions of sparse symmetric matrices

08/15/2023
by   Andreas Frommer, et al.
0

We consider the problem of estimating the trace of a matrix function f(A). In certain situations, in particular if f(A) cannot be well approximated by a low-rank matrix, combining probing methods based on graph colorings with stochastic trace estimation techniques can yield accurate approximations at moderate cost. So far, such methods have not been thoroughly analyzed, though, but were rather used as efficient heuristics by practitioners. In this manuscript, we perform a detailed analysis of stochastic probing methods and, in particular, expose conditions under which the expected approximation error in the stochastic probing method scales more favorably with the dimension of the matrix than the error in non-stochastic probing. Extending results from [E. Aune, D. P. Simpson, J. Eidsvik, Parameter estimation in high dimensional Gaussian distributions, Stat. Comput., 24, pp. 247–263, 2014], we also characterize situations in which using just one stochastic vector is always – not only in expectation – better than the deterministic probing method. Several numerical experiments illustrate our theory and compare with existing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2022

Krylov-aware stochastic trace estimation

We introduce an algorithm for estimating the trace of a matrix function ...
research
12/19/2022

Computation of the von Neumann entropy of large matrices via trace estimators and rational Krylov methods

We consider the problem of approximating the von Neumann entropy of a la...
research
09/03/2020

Analysis of probing techniques for sparse approximation and trace estimation of decaying matrix functions

The computation of matrix functions f(A), or related quantities like the...
research
07/03/2023

An analysis on stochastic Lanczos quadrature with asymmetric quadrature nodes

The stochastic Lanczos quadrature method has garnered significant attent...
research
01/01/2021

Faster Stochastic Trace Estimation with a Chebyshev Product Identity

Methods for stochastic trace estimation often require the repeated evalu...
research
09/22/2021

Improved variants of the Hutch++ algorithm for trace estimation

This paper is concerned with two improved variants of the Hutch++ algori...
research
12/20/2017

A Distributed Frank-Wolfe Framework for Learning Low-Rank Matrices with the Trace Norm

We consider the problem of learning a high-dimensional but low-rank matr...

Please sign up or login with your details

Forgot password? Click here to reset