Gradient-based kernel dimension reduction for supervised learning

09/02/2011
by   Kenji Fukumizu, et al.
0

This paper proposes a novel kernel approach to linear dimension reduction for supervised learning. The purpose of the dimension reduction is to find directions in the input space to explain the output as effectively as possible. The proposed method uses an estimator for the gradient of regression function, based on the covariance operators on reproducing kernel Hilbert spaces. In comparison with other existing methods, the proposed one has wide applicability without strong assumptions on the distributions or the type of variables, and uses computationally simple eigendecomposition. Experimental results show that the proposed method successfully finds the effective directions with efficient computation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/05/2021

An RKHS-Based Semiparametric Approach to Nonlinear Sufficient Dimension Reduction

Based on the theory of reproducing kernel Hilbert space (RKHS) and semip...
research
07/22/2022

A Supervised Tensor Dimension Reduction-Based Prognostics Model for Applications with Incomplete Imaging Data

This paper proposes a supervised dimension reduction methodology for ten...
research
06/20/2016

Continuum directions for supervised dimension reduction

Dimension reduction of multivariate data supervised by auxiliary informa...
research
06/10/2020

Deep Dimension Reduction for Supervised Representation Learning

The success of deep supervised learning depends on its automatic data re...
research
04/16/2018

Deep Embedding Kernel

In this paper, we propose a novel supervised learning method that is cal...
research
01/01/2019

Supervised Coarse-Graining of Composite Objects

We consider supervised dimension reduction for regression with composite...
research
04/29/2020

Wavelet-based estimation in a semiparametric regression model

In this paper, we introduce a wavelet-based method for estimating the ED...

Please sign up or login with your details

Forgot password? Click here to reset