The Lanczos Algorithm Under Few Iterations: Concentration and Location of the Ritz Values

04/12/2019
by   Jorge Garza Vargas, et al.
0

We study the Lanczos algorithm where the initial vector is sampled uniformly from S^n-1. Let A be an n × n Hermitian matrix. We show that when run for few iterations, the output of the algorithm on A is almost deterministic. For instance, we show that there exists c >0 depending only on a certain global property of the spectrum of A (in particular, not depending on n) such that when Lanczos is run for at most c n iterations, the Jacobi coefficients and the Ritz values deviate from their medians by t with probability at most e^-√(n) t^2, for t< A _op. Furthermore, we show that the Lanczos algorithm fails with high probability to identify outliers of the spectrum when run for at most c' n iterations, where again c' depends only on the same global property of the spectrum of A. Classical results imply that the bound c' n is tight up to a constant factor. Our techniques also yield asymptotic results: Suppose we have a sequence of Hermitian matrices A_n ∈ M_n(C) whose spectral distributions converge in Kolmogorov distance with rate O(n^-ε) to a density, for some ε > 0. Then we show that for large enough n, and for k=O(√( n)), the Ritz values after k iterations concentrate around the roots of the kth orthogonal polynomial with respect to the limiting density.

READ FULL TEXT
research
06/02/2021

Tight High Probability Bounds for Linear Stochastic Approximation with Fixed Stepsize

This paper provides a non-asymptotic analysis of linear stochastic appro...
research
08/05/2022

A Tight Analysis of Hutchinson's Diagonal Estimator

Let 𝐀∈ℝ^n× n be a matrix with diagonal diag(𝐀) and let 𝐀̅ be 𝐀 with its ...
research
06/18/2021

Stochastic parareal: an application of probabilistic methods to time-parallelisation

Parareal is a well-studied algorithm for numerically integrating systems...
research
01/25/2019

The conjugate gradient algorithm on well-conditioned Wishart matrices is almost deteriministic

We prove that the number of iterations required to solve a random positi...
research
11/26/2019

Pseudo-deterministic Streaming

A pseudo-deterministic algorithm is a (randomized) algorithm which, when...
research
05/13/2021

Analysis of stochastic Lanczos quadrature for spectrum approximation

The cumulative empirical spectral measure (CESM) Φ[𝐀] : ℝ→ [0,1] of a n×...
research
02/27/2018

The Emergence of Spectral Universality in Deep Networks

Recent work has shown that tight concentration of the entire spectrum of...

Please sign up or login with your details

Forgot password? Click here to reset