Matrix anti-concentration inequalities with applications

11/10/2021
by   Zipei Nie, et al.
0

We provide a polynomial lower bound on the minimum singular value of an m× m random matrix M with jointly Gaussian entries, under a polynomial bound on the matrix norm and a global small-ball probability bound inf_x,y∈ S^m-1ℙ(|x^* M y|>m^-O(1))≥1/2. With the additional assumption that M is self-adjoint, the global small-ball probability bound can be replaced by a weaker version. We establish two matrix anti-concentration inequalities, which lower bound the minimum singular values of the sum of independent positive semidefinite self-adjoint matrices and the linear combination of independent random matrices with independent Gaussian coefficients. Both are under a global small-ball probability assumption. As a major application, we prove a better singular value bound for the Krylov space matrix, which leads to a faster and simpler algorithm for solving sparse linear systems. Our algorithm runs in Õ(n^3ω-4/ω-1)=O(n^2.2716) time where ω<2.37286 is the matrix multiplication exponent, improving on the previous fastest one in Õ(n^5ω-4/ω+1)=O(n^2.33165) time by Peng and Vempala.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/03/2020

On the smoothed analysis of the smallest singular value with discrete noise

Let A be an n× n real matrix, and let M be an n× n random matrix whose e...
research
07/20/2020

Solving Sparse Linear Systems Faster than Matrix Multiplication

Can linear systems be solved faster than matrix multiplication? While th...
research
11/21/2020

Multilevel symmetrized Toeplitz structures and spectral distribution results for the related matrix-sequences

In recent years, motivated by computational purposes, the singular value...
research
08/18/2010

Learning Functions of Few Arbitrary Linear Parameters in High Dimensions

Let us assume that f is a continuous function defined on the unit ball o...
research
08/29/2019

Smoothed analysis of the least singular value without inverse Littlewood-Offord theory

We study the lower tail behavior of the least singular value of an n× n ...
research
01/04/2021

Benign overfitting without concentration

We obtain a sufficient condition for benign overfitting of linear regres...
research
04/09/2011

Dimension-free tail inequalities for sums of random matrices

We derive exponential tail inequalities for sums of random matrices with...

Please sign up or login with your details

Forgot password? Click here to reset