Supervised Kernel PCA For Longitudinal Data

08/20/2018
by   Patrick Staples, et al.
0

In statistical learning, high covariate dimensionality poses challenges for robust prediction and inference. To address this challenge, supervised dimension reduction is often performed, where dependence on the outcome is maximized for a selected covariate subspace with smaller dimensionality. Prevalent dimension reduction techniques assume data are i.i.d., which is not appropriate for longitudinal data comprising multiple subjects with repeated measurements over time. In this paper, we derive a decomposition of the Hilbert-Schmidt Independence Criterion as a supervised loss function for longitudinal data, enabling dimension reduction between and within clusters separately, and propose a dimensionality-reduction technique, sklPCA, that performs this decomposed dimension reduction. We also show that this technique yields superior model accuracy compared to the model it extends.

READ FULL TEXT
research
09/09/2021

Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

Principal component analysis (PCA) is a well-known linear dimension-redu...
research
02/17/2022

Dimension Reduction via Supervised Clustering of Regression Coefficients: A Review

The development and use of dimension reduction methods is prevalent in m...
research
07/30/2021

Tail inverse regression for dimension reduction with extreme response

We consider the problem of dimensionality reduction for prediction of a ...
research
05/09/2018

Nonparametric Estimation of Conditional Expectation with Auxiliary Information and Dimension Reduction

Nonparametric estimation of the conditional expectation E(Y | U) of an o...
research
09/06/2019

Spectral Non-Convex Optimization for Dimension Reduction with Hilbert-Schmidt Independence Criterion

The Hilbert Schmidt Independence Criterion (HSIC) is a kernel dependence...
research
03/12/2014

A survey of dimensionality reduction techniques

Experimental life sciences like biology or chemistry have seen in the re...
research
02/16/2018

Parameter-free Network Sparsification and Data Reduction by Minimal Algorithmic Information Loss

The study of large and complex datasets, or big data, organized as netwo...

Please sign up or login with your details

Forgot password? Click here to reset