Fast algorithms for robust principal component analysis with an upper bound on the rank

08/18/2020
by   Ningyu Sha, et al.
36

The robust principal component analysis (RPCA) decomposes a data matrix into a low-rank part and a sparse part. There are mainly two types of algorithms for RPCA. The first type of algorithm applies regularization terms on the singular values of a matrix to obtain a low-rank matrix. However, calculating singular values can be very expensive for large matrices. The second type of algorithm replaces the low-rank matrix as the multiplication of two small matrices. They are faster than the first type because no singular value decomposition (SVD) is required. However, the rank of the low-rank matrix is required, and an accurate rank estimation is needed to obtain a reasonable solution. In this paper, we propose algorithms that combine both types. Our proposed algorithms require an upper bound of the rank and SVD on small matrices. First, they are faster than the first type because the cost of SVD on small matrices is negligible. Second, they are more robust than the second type because an upper bound of the rank instead of the exact rank is required. Furthermore, we apply the Gauss-Newton method to increase the speed of our algorithms. Numerical experiments show the better performance of our proposed algorithms.

READ FULL TEXT

page 13

page 16

page 17

11/06/2020

Randomized Quaternion Singular Value Decomposition for Low-Rank Approximation

Quaternion matrix approximation problems construct the approximated matr...
05/16/2021

Fast randomized numerical rank estimation

Matrices with low-rank structure are ubiquitous in scientific computing....
12/03/2020

Average-Case Integrality Gap for Non-Negative Principal Component Analysis

Montanari and Richard (2015) asked whether a natural semidefinite progra...
04/16/2019

RES-PCA: A Scalable Approach to Recovering Low-rank Matrices

Robust principal component analysis (RPCA) has drawn significant attenti...
05/13/2019

Fast Proper Orthogonal Decomposition Using Improved Sampling and Iterative Techniques for Singular Value Decomposition

Proper Orthogonal Decomposition (POD), also known as Principal component...
02/15/2018

Fast Generalized Conditional Gradient Method with Applications to Matrix Recovery Problems

Motivated by matrix recovery problems such as Robust Principal Component...
09/27/2016

A Fast Factorization-based Approach to Robust PCA

Robust principal component analysis (RPCA) has been widely used for reco...