Projection techniques to update the truncated SVD of evolving matrices

10/13/2020
by   Vassilis Kalantzis, et al.
0

This paper considers the problem of updating the rank-k truncated Singular Value Decomposition (SVD) of matrices subject to the addition of new rows and/or columns over time. Such matrix problems represent an important computational kernel in applications such as Latent Semantic Indexing and Recommender Systems. Nonetheless, the proposed framework is purely algebraic and targets general updating problems. The algorithm presented in this paper undertakes a projection view-point and focuses on building a pair of subspaces which approximate the linear span of the sought singular vectors of the updated matrix. We discuss and analyze two different choices to form the projection subspaces. Results on matrices from real applications suggest that the proposed algorithm can lead to higher accuracy, especially for the singular triplets associated with the largest modulus singular values. Several practical details and key differences with other approaches are also discussed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/08/2017

A Hierarchical Singular Value Decomposition Algorithm for Low Rank Matrices

Singular value decomposition (SVD) is a widely used technique for dimens...
research
04/21/2021

Accurate and fast matrix factorization for low-rank learning

In this paper we tackle two important challenges related to the accurate...
research
05/15/2020

Batched computation of the singular value decompositions of order two by the AVX-512 vectorization

In this paper a vectorized algorithm for simultaneously computing up to ...
research
11/10/2020

Fast and Accurate Proper Orthogonal Decomposition using Efficient Sampling and Iterative Techniques for Singular Value Decomposition

In this paper, we propose a computationally efficient iterative algorith...
research
06/09/2022

Limit results for distributed estimation of invariant subspaces in multiple networks inference and PCA

We study the problem of estimating the left and right singular subspaces...
research
10/19/2017

Early stopping for statistical inverse problems via truncated SVD estimation

We consider truncated SVD (or spectral cut-off, projection) estimators f...
research
08/17/2022

Distributed Out-of-Memory SVD on CPU/GPU Architectures

We propose an efficient, distributed, out-of-memory implementation of th...

Please sign up or login with your details

Forgot password? Click here to reset