Residual Component Analysis

06/21/2011
by   Alfredo A. Kalaitzis, et al.
0

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an eigenvalue problem on the sample covariance matrix. In this paper we consider the situation where the data variance is already partially explained by other factors, e.g. covariates of interest, or temporal correlations leaving some residual variance. We decompose the residual variance into its components through a generalized eigenvalue problem, which we call residual component analysis (RCA). We show that canonical covariates analysis (CCA) is a special case of our algorithm and explore a range of new algorithms that arise from the framework. We illustrate the ideas on a gene expression time series data set and the recovery of human pose from silhouette.

READ FULL TEXT
research
03/25/2019

Eigenvalue and Generalized Eigenvalue Problems: Tutorial

This paper is a tutorial for eigenvalue and generalized eigenvalue probl...
research
03/10/2023

Generalized Spherical Principal Component Analysis

Outliers contaminating data sets are a challenge to statistical estimato...
research
08/31/2018

Generalized probabilistic principal component analysis of correlated data

Principal component analysis (PCA) is a well-established tool in machine...
research
03/03/2016

Whitening-Free Least-Squares Non-Gaussian Component Analysis

Non-Gaussian component analysis (NGCA) is an unsupervised linear dimensi...
research
04/19/2011

High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections

We consider the problem of inferring the interactions between a set of N...
research
07/28/2023

Stratified Principal Component Analysis

This paper investigates a general family of models that stratifies the s...
research
08/28/2018

Convergence of Krasulina Scheme

Principal component analysis (PCA) is one of the most commonly used stat...

Please sign up or login with your details

Forgot password? Click here to reset