DeepAI
Log In Sign Up

Fast and Accurate Pseudoinverse with Sparse Matrix Reordering and Incremental Approach

11/09/2020
by   Jinhong Jung, et al.
0

How can we compute the pseudoinverse of a sparse feature matrix efficiently and accurately for solving optimization problems? A pseudoinverse is a generalization of a matrix inverse, which has been extensively utilized as a fundamental building block for solving linear systems in machine learning. However, an approximate computation, let alone an exact computation, of pseudoinverse is very time-consuming due to its demanding time complexity, which limits it from being applied to large data. In this paper, we propose FastPI (Fast PseudoInverse), a novel incremental singular value decomposition (SVD) based pseudoinverse method for sparse matrices. Based on the observation that many real-world feature matrices are sparse and highly skewed, FastPI reorders and divides the feature matrix and incrementally computes low-rank SVD from the divided components. To show the efficacy of proposed FastPI, we apply them in real-world multi-label linear regression problems. Through extensive experiments, we demonstrate that FastPI computes the pseudoinverse faster than other approximate methods without loss of accuracy. compared to full-rank SVD based approach. Results imply that our method efficiently computes the low-rank pseudoinverse of a large and sparse matrix that other existing methods cannot handle with limited time and space.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/08/2017

A Hierarchical Singular Value Decomposition Algorithm for Low Rank Matrices

Singular value decomposition (SVD) is a widely used technique for dimens...
10/25/2021

Fast estimation method for rank of a high-dimensional sparse matrix

Numerical computing the rank of a matrix is a fundamental problem in sci...
05/02/2018

TR-SVD: Fast and Memory Efficient Method for Time Ranged Singular Value Decomposition

Given multiple time series data, how can we efficiently find latent patt...
04/11/2022

An answer to an open question in the incremental SVD

Incremental singular value decomposition (SVD) was proposed by Brand to ...
05/30/2014

Online and Adaptive Pseudoinverse Solutions for ELM Weights

The ELM method has become widely used for classification and regressions...
07/02/2018

Multi-distance Support Matrix Machines

Real-world data such as digital images, MRI scans and electroencephalogr...