DeepAI AI Chat
Log In Sign Up

High-probability bounds for the reconstruction error of PCA

09/24/2019
by   Cassandra Uebel, et al.
Humboldt-Universität zu Berlin
0

We identify principal component analysis (PCA) as an empirical risk minimization problem and prove error bounds that hold with high probability. More precisely, we derive upper bounds for the reconstruction error of PCA that can be expressed relative to the minimal reconstruction error. The significance of these bounds is shown for the cases of functional and kernel PCA. In such scenarios, the eigenvalues of the covariance operator often decay at a polynomial or nearly exponential rate. Our results yield that the reconstruction error of PCA achieves the same rate as the minimal reconstruction error.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/08/2022

Entrywise Recovery Guarantees for Sparse PCA via Sparsistent Algorithms

Sparse Principal Component Analysis (PCA) is a prevalent tool across a p...
12/18/2020

Upper and Lower Bounds on the Performance of Kernel PCA

Principal Component Analysis (PCA) is a popular method for dimension red...
05/06/2020

A Communication-Efficient Distributed Algorithm for Kernel Principal Component Analysis

Principal Component Analysis (PCA) is a fundamental technology in machin...
05/30/2020

An Analytical Formula for Spectrum Reconstruction

We study the spectrum reconstruction technique. As is known to all, eige...
05/25/2021

Robust Principal Component Analysis Using a Novel Kernel Related with the L1-Norm

We consider a family of vector dot products that can be implemented usin...
06/26/2019

Principal Component Analysis for Multivariate Extremes

The first order behavior of multivariate heavy-tailed random vectors abo...