Gaussian Process Regression for Out-of-Sample Extension

03/07/2016
by   Oren Barkan, et al.
0

Manifold learning methods are useful for high dimensional data analysis. Many of the existing methods produce a low dimensional representation that attempts to describe the intrinsic geometric structure of the original data. Typically, this process is computationally expensive and the produced embedding is limited to the training data. In many real life scenarios, the ability to produce embedding of unseen samples is essential. In this paper we propose a Bayesian non-parametric approach for out-of-sample extension. The method is based on Gaussian Process Regression and independent of the manifold learning algorithm. Additionally, the method naturally provides a measure for the degree of abnormality for a newly arrived data point that did not participate in the training process. We derive the mathematical connection between the proposed method and the Nystrom extension and show that the latter is a special case of the former. We present extensive experimental results that demonstrate the performance of the proposed method and compare it to other existing out-of-sample extension methods.

READ FULL TEXT
research
11/03/2015

PCA-Based Out-of-Sample Extension for Dimensionality Reduction

Dimensionality reduction methods are very common in the field of high di...
research
06/25/2015

Diffusion Nets

Non-linear manifold learning enables high-dimensional data analysis, but...
research
02/09/2015

Out-of-sample generalizations for supervised manifold learning for classification

Supervised manifold learning methods for data classification map data sa...
research
11/29/2021

Graph Embedding via High Dimensional Model Representation for Hyperspectral Images

Learning the manifold structure of remote sensing images is of paramount...
research
06/27/2016

Out-of-Sample Extension for Dimensionality Reduction of Noisy Time Series

This paper proposes an out-of-sample extension framework for a global ma...
research
01/28/2019

On Random Subsampling of Gaussian Process Regression: A Graphon-Based Analysis

In this paper, we study random subsampling of Gaussian process regressio...
research
06/22/2022

Regression Trees on Grassmann Manifold for Adapting Reduced-Order Models

Low dimensional and computationally less expensive Reduced-Order Models ...

Please sign up or login with your details

Forgot password? Click here to reset