Continuum directions for supervised dimension reduction

06/20/2016
by   Sungkyu Jung, et al.
0

Dimension reduction of multivariate data supervised by auxiliary information is considered. A series of basis for dimension reduction is obtained as minimizers of a novel criterion. The proposed method is akin to continuum regression, and the resulting basis is called continuum directions. With a presence of binary supervision data, these directions continuously bridge the principal component, mean difference and linear discriminant directions, thus ranging from unsupervised to fully supervised dimension reduction. High-dimensional asymptotic studies of continuum directions for binary supervision reveal several interesting facts. The conditions under which the sample continuum directions are inconsistent, but their classification performance is good, are specified. While the proposed method can be directly used for binary and multi-category classification, its generalizations to incorporate any form of auxiliary data are also presented. The proposed method enjoys fast computation, and the performance is better or on par with more computer-intensive alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/19/2020

Sufficient dimension reduction for classification using principal optimal transport direction

Sufficient dimension reduction is used pervasively as a supervised dimen...
research
09/02/2011

Gradient-based kernel dimension reduction for supervised learning

This paper proposes a novel kernel approach to linear dimension reductio...
research
02/11/2023

Dimension Reduction and MARS

The multivariate adaptive regression spline (MARS) is one of the popular...
research
01/13/2019

Image retrieval method based on CNN and dimension reduction

An image retrieval method based on convolution neural network and dimens...
research
05/25/2018

On the Estimation of Entropy in the FastICA Algorithm

The fastICA algorithm is a popular dimension reduction technique used to...
research
06/20/2020

Weakly-correlated synapses promote dimension reduction in deep neural networks

By controlling synaptic and neural correlations, deep learning has achie...
research
04/07/2020

Optimal Projections for Gaussian Discriminants

The problem of obtaining optimal projections for performing discriminant...

Please sign up or login with your details

Forgot password? Click here to reset