An Acceleration Scheme for Memory Limited, Streaming PCA

07/17/2018
by   Salaheddin Alakkari, et al.
0

In this paper, we propose an acceleration scheme for online memory-limited PCA methods. Our scheme converges to the first k>1 eigenvectors in a single data pass. We provide empirical convergence results of our scheme based on the spiked covariance model. Our scheme does not require any predefined parameters such as the eigengap and hence is well facilitated for streaming data scenarios. Furthermore, we apply our scheme to challenging time-varying systems where online PCA methods fail to converge. Specifically, we discuss a family of time-varying systems that are based on Molecular Dynamics simulations where batch PCA converges to the actual analytic solution of such systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2019

AdaOja: Adaptive Learning Rates for Streaming PCA

Oja's algorithm has been the cornerstone of streaming methods in Princip...
research
09/07/2017

Adaptive PCA for Time-Varying Data

In this paper, we present an online adaptive PCA algorithm that is able ...
research
03/05/2021

Online Graph Learning under Smoothness Priors

The growing success of graph signal processing (GSP) approaches relies h...
research
09/29/2017

Comparison of PCA with ICA from data distribution perspective

We performed an empirical comparison of ICA and PCA algorithms by applyi...
research
10/31/2015

Preconditioned Data Sparsification for Big Data with Applications to PCA and K-means

We analyze a compression scheme for large data sets that randomly keeps ...
research
06/12/2018

Streaming PCA and Subspace Tracking: The Missing Data Case

For many modern applications in science and engineering, data are collec...
research
11/19/2019

Discussion contribution "Functional models for time-varying random objects” by Dubey and Müller (to appear in JRSS-B)

In an inspiring paper Dubey and Müller (DM) extend PCA to the case that ...

Please sign up or login with your details

Forgot password? Click here to reset