Low Rank Approximation Directed by Leverage Scores and Computed at Sub-linear Cost

06/10/2019
by   Victor Y. Pan, et al.
0

Low rank approximation (LRA) of a matrix is a major subject of matrix and tensor computations and data mining and analysis. It is desired (and even imperative in applications to Big Data) to solve the problem at sub-linear cost, involving much fewer memory cells and arithmetic operations than an input matrix has entries, but this is impossible even for a small matrix family of our Appendix. Nevertheless we prove that this is possible with a high probability (whp) for random matrices admitting LRA. Namely we recall the known randomized algorithms that solve the LRA problem whp for any matrix admitting LRA by relying on the computation of the so called leverage scores. That computation has super-linear cost, but we simplify the solution algorithm and run it at sub-linear cost by trivializing the computation of leverage scores. Then we prove that whp the resulting algorithms output accurate LRA of a random input matrix admitting LRA.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/11/2019

Low Rank Approximation at Sublinear Cost by Means of Subspace Sampling

Low Rank Approximation (LRA) of a matrix is a hot research subject, fund...
research
07/21/2019

Low Rank Approximation of a Matrix at Sub-linear Cost

A matrix algorithm performs at sub-linear cost if it uses much fewer flo...
research
06/10/2019

Refinement of Low Rank Approximation of a Matrix at Sub-linear Cost

Low rank approximation (LRA) of a matrix is a hot subject of modern comp...
research
01/25/2022

Sketching Matrix Least Squares via Leverage Scores Estimates

We consider the matrix least squares problem of the form 𝐀𝐗-𝐁_F^2 where ...
research
10/14/2014

Tighter Low-rank Approximation via Sampling the Leveraged Element

In this work, we propose a new randomized algorithm for computing a low-...
research
06/21/2022

Algorithmic Gaussianization through Sketching: Converting Data into Sub-gaussian Random Designs

Algorithmic Gaussianization is a phenomenon that can arise when using ra...
research
04/09/2018

Faster Anomaly Detection via Matrix Sketching

We present efficient streaming algorithms to compute two commonly used a...

Please sign up or login with your details

Forgot password? Click here to reset