Supervised PCA: A Multiobjective Approach

by   Alexander Ritchie, et al.

Methods for supervised principal component analysis (SPCA) aim to incorporate label information into principal component analysis (PCA), so that the extracted features are more useful for a prediction task of interest. Prior work on SPCA has focused primarily on optimizing prediction error, and has neglected the value of maximizing variance explained by the extracted features. We propose a new method for SPCA that addresses both of these objectives jointly, and demonstrate empirically that our approach dominates existing approaches, i.e., outperforms them with respect to both prediction error and variation explained. Our approach accommodates arbitrary supervised learning losses and, through a statistical reformulation, provides a novel low-rank extension of generalized linear models.


page 10

page 12


Generalized Principal Component Analysis

Generalized principal component analysis (GLM-PCA) facilitates dimension...

All Sparse PCA Models Are Wrong, But Some Are Useful. Part I: Computation of Scores, Residuals and Explained Variance

Sparse Principal Component Analysis (sPCA) is a popular matrix factoriza...

ReFACTor: Practical Low-Rank Matrix Estimation Under Column-Sparsity

Various problems in data analysis and statistical genetics call for reco...

Principal Component Classification

We propose to directly compute classification estimates by learning feat...

AugmentedPCA: A Python Package of Supervised and Adversarial Linear Factor Models

Deep autoencoders are often extended with a supervised or adversarial lo...

A semi-group approach to Principal Component Analysis

Principal Component Analysis (PCA) is a well known procedure to reduce i...

Voxelwise principal component analysis of dynamic [S-methyl-11C]methionine PET data in glioma patients

Recent works have demonstrated the added value of dynamic amino acid pos...

Please sign up or login with your details

Forgot password? Click here to reset