Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detection

10/11/2021
by   HanQin Cai, et al.
15

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for high-dimensional RPCA problems, which we call Learned Robust PCA (LRPCA). LRPCA is highly efficient, and its free parameters can be effectively learned to optimize via deep unfolding. Moreover, we extend deep unfolding from finite iterations to infinite iterations via a novel feedforward-recurrent-mixed neural network model. We establish the recovery guarantee of LRPCA under mild assumptions for RPCA. Numerical experiments show that LRPCA outperforms the state-of-the-art RPCA algorithms, such as ScaledGD and AltProj, on both synthetic datasets and real-world applications.

READ FULL TEXT

page 10

page 25

research
04/23/2015

Robust Principal Component Analysis on Graphs

Principal Component Analysis (PCA) is the most widely used tool for line...
research
08/12/2018

Robust high dimensional factor models with applications to statistical machine learning

Factor models are a class of powerful statistical models that have been ...
research
10/28/2014

Non-convex Robust PCA

We propose a new method for robust PCA -- the task of recovering a low-r...
research
11/08/2011

Robust PCA as Bilinear Decomposition with Outlier-Sparsity Regularization

Principal component analysis (PCA) is widely used for dimensionality red...
research
07/29/2015

Fast Robust PCA on Graphs

Mining useful clusters from high dimensional data has received significa...
research
02/02/2017

Side Information in Robust Principal Component Analysis: Algorithms and Applications

Robust Principal Component Analysis (RPCA) aims at recovering a low-rank...
research
06/22/2023

PCA matrix denoising is uniform

Principal component analysis (PCA) is a simple and popular tool for proc...

Please sign up or login with your details

Forgot password? Click here to reset