Optimal Query Complexities for Dynamic Trace Estimation

09/30/2022
by   David P. Woodruff, et al.
0

We consider the problem of minimizing the number of matrix-vector queries needed for accurate trace estimation in the dynamic setting where our underlying matrix is changing slowly, such as during an optimization process. Specifically, for any m matrices A_1,...,A_m with consecutive differences bounded in Schatten-1 norm by α, we provide a novel binary tree summation procedure that simultaneously estimates all m traces up to ϵ error with δ failure probability with an optimal query complexity of O(m α√(log(1/δ))/ϵ + mlog(1/δ)), improving the dependence on both α and δ from Dharangutte and Musco (NeurIPS, 2021). Our procedure works without additional norm bounds on A_i and can be generalized to a bound for the p-th Schatten norm for p ∈ [1,2], giving a complexity of O(m α(√(log(1/δ))/ϵ)^p +m log(1/δ)). By using novel reductions to communication complexity and information-theoretic analyses of Gaussian matrices, we provide matching lower bounds for static and dynamic trace estimation in all relevant parameters, including the failure probability. Our lower bounds (1) give the first tight bounds for Hutchinson's estimator in the matrix-vector product model with Frobenius norm error even in the static setting, and (2) are the first unconditional lower bounds for dynamic trace estimation, resolving open questions of prior work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2023

On the Optimal Bounds for Noisy Computing

We revisit the problem of computing with noisy information considered in...
research
05/17/2022

New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemma

We prove new lower bounds for statistical estimation tasks under the con...
research
10/20/2022

Local lower bounds on characteristics of quantum and classical systems

We consider methods of obtaining local lower bounds on characteristics o...
research
04/14/2020

Norm and trace estimation with random rank-one vectors

A few matrix-vector multiplications with random vectors are often suffic...
research
04/18/2023

Optimal Eigenvalue Approximation via Sketching

Given a symmetric matrix A, we show from the simple sketch GAG^T, where ...
research
10/26/2021

Dynamic Trace Estimation

We study a dynamic version of the implicit trace estimation problem. Giv...
research
09/28/2018

Minimax Lower Bounds for H_∞-Norm Estimation

The problem of estimating the H_∞-norm of an LTI system from noisy input...

Please sign up or login with your details

Forgot password? Click here to reset