Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

09/09/2021
by   Shaojie Xu, et al.
15

Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input variable that contains maximal variation and preserves as much information as possible. PCA has also been used in prediction models where the original, high-dimensional space of predictors is reduced to a smaller, more manageable, set before conducting regression analysis. However, this approach does not incorporate information in the response during the dimension-reduction stage and hence can have poor predictive performance. To address this concern, several supervised linear dimension-reduction techniques have been proposed in the literature. This paper reviews selected techniques, extends some of them, and compares their performance through simulations. Two of these techniques, partial least squares (PLS) and least-squares PCA (LSPCA), consistently outperform the others in this study.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2020

Torus Probabilistic Principal Component Analysis

One of the most common problems that any technique encounters is the hig...
research
08/20/2018

Supervised Kernel PCA For Longitudinal Data

In statistical learning, high covariate dimensionality poses challenges ...
research
11/17/2022

Data Dimension Reduction makes ML Algorithms efficient

Data dimension reduction (DDR) is all about mapping data from high dimen...
research
02/06/2019

Principal Model Analysis Based on Partial Least Squares

Motivated by the Bagging Partial Least Squares (PLS) and Principal Compo...
research
03/31/2021

Dimension reduction of open-high-low-close data in candlestick chart based on pseudo-PCA

The (open-high-low-close) OHLC data is the most common data form in the ...
research
04/17/2012

Regularized Partial Least Squares with an Application to NMR Spectroscopy

High-dimensional data common in genomics, proteomics, and chemometrics o...
research
07/15/2023

Supervised Dynamic PCA: Linear Dynamic Forecasting with Many Predictors

This paper proposes a novel dynamic forecasting method using a new super...

Please sign up or login with your details

Forgot password? Click here to reset