An answer to an open question in the incremental SVD

04/11/2022
by   Yangwen Zhang, et al.
0

Incremental singular value decomposition (SVD) was proposed by Brand to efficiently compute the SVD of a matrix. The algorithm needs to compute thousands or millions of orthogonal matrices and to multiply them together. However, the multiplications may corrode the orthogonality. Hence many reorthogonalizations are needed in practice. In [Linear Algebra and its Applications 415 (2006) 20-30], Brand asked "It is an open question how often this is necessary to guarantee a certain overall level of numerical precision; it does not change the overall complexity." In this paper, we answer this question and the answer is we can avoid computing the large amount of those orthogonal matrices and hence the reorthogonalizations are not necessary by modifying his algorithm. We prove that the modification does not change the outcomes of the algorithm. Numerical experiments are presented to illustrate the performance of our modification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/21/2013

On GROUSE and Incremental SVD

GROUSE (Grassmannian Rank-One Update Subspace Estimation) is an incremen...
research
09/29/2020

What if Neural Networks had SVDs?

Various Neural Networks employ time-consuming matrix operations like mat...
research
09/10/2022

A mixed precision Jacobi SVD algorithm

We propose a mixed precision Jacobi algorithm for computing the singular...
research
04/03/2021

Convergence Analysis of the Rank-Restricted Soft SVD Algorithm

The soft SVD is a robust matrix decomposition algorithm and a key compon...
research
03/30/2023

Matrix diagonalization and singular value decomposition: Static SageMath and dynamic ChatGPT juxtaposed

We investigated some difficulties that students often face when studying...
research
03/10/2020

Error Estimation for Sketched SVD via the Bootstrap

In order to compute fast approximations to the singular value decomposit...
research
06/04/2018

MOSES: A Streaming Algorithm for Linear Dimensionality Reduction

This paper introduces Memory-limited Online Subspace Estimation Scheme (...

Please sign up or login with your details

Forgot password? Click here to reset