A perturbation based out-of-sample extension framework

09/07/2020
by   Roy Mitz, et al.
0

Out-of-sample extension is an important task in various kernel based non-linear dimensionality reduction algorithms. In this paper, we derive a perturbation based extension framework by extending results from classical perturbation theory. We prove that our extension framework generalizes the well-known Nyström method as well as some of its variants. We provide an error analysis for our extension framework, and suggest new forms of extension under this framework that take advantage of the structure of the kernel matrix. We support our theoretical results numerically and demonstrate the advantages of our extension framework both on synthetic and real data.

READ FULL TEXT
research
11/03/2015

PCA-Based Out-of-Sample Extension for Dimensionality Reduction

Dimensionality reduction methods are very common in the field of high di...
research
04/19/2018

Mathematical Analysis on Out-of-Sample Extensions

Let X=X∪Z be a data set in R^D, where X is the training set and Z is the...
research
11/20/2017

Positive semi-definite embedding for dimensionality reduction and out-of-sample extensions

In machine learning or statistics, it is often desirable to reduce the d...
research
06/20/2017

Unperturbed: spectral analysis beyond Davis-Kahan

Classical matrix perturbation results, such as Weyl's theorem for eigenv...
research
06/27/2016

Out-of-Sample Extension for Dimensionality Reduction of Noisy Time Series

This paper proposes an out-of-sample extension framework for a global ma...
research
05/28/2021

Perturbation Theory for the Information Bottleneck

Extracting relevant information from data is crucial for all forms of le...
research
05/01/2013

Inverting Nonlinear Dimensionality Reduction with Scale-Free Radial Basis Function Interpolation

Nonlinear dimensionality reduction embeddings computed from datasets do ...

Please sign up or login with your details

Forgot password? Click here to reset