Randomized algorithms for low-rank matrix approximation: Design, analysis, and applications

06/21/2023
by   Joel A. Tropp, et al.
0

This survey explores modern approaches for computing low-rank approximations of high-dimensional matrices by means of the randomized SVD, randomized subspace iteration, and randomized block Krylov iteration. The paper compares the procedures via theoretical analyses and numerical studies to highlight how the best choice of algorithm depends on spectral properties of the matrix and the computational resources available. Despite superior performance for many problems, randomized block Krylov iteration has not been widely adopted in computational science. This paper strengthens the case for this method in three ways. First, it presents new pseudocode that can significantly reduce computational costs. Second, it provides a new analysis that yields simple, precise, and informative error bounds. Last, it showcases applications to challenging scientific problems, including principal component analysis for genetic data and spectral clustering for molecular dynamics data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2020

Pass-Efficient Randomized LU Algorithms for Computing Low-Rank Matrix Approximation

Low-rank matrix approximation is extremely useful in the analysis of dat...
research
06/08/2019

Study of Compressed Randomized UTV Decompositions for Low-Rank Matrix Approximations in Data Science

In this work, a novel rank-revealing matrix decomposition algorithm term...
research
10/01/2021

Randomized block Krylov methods for approximating extreme eigenvalues

Randomized block Krylov subspace methods form a powerful class of algori...
research
07/21/2020

Spectral Clustering using Eigenspectrum Shape Based Nystrom Sampling

Spectral clustering has shown a superior performance in analyzing the cl...
research
11/21/2018

Randomized Rank-Revealing UZV Decomposition for Low-Rank Approximation of Matrices

Low-rank matrix approximation plays an increasingly important role in si...
research
02/16/2022

Improved analysis of randomized SVD for top-eigenvector approximation

Computing the top eigenvectors of a matrix is a problem of fundamental i...
research
09/24/2021

An Improved Frequent Directions Algorithm for Low-Rank Approximation via Block Krylov Iteration

Frequent Directions, as a deterministic matrix sketching technique, has ...

Please sign up or login with your details

Forgot password? Click here to reset