Perturbation Bounds for Procrustes, Classical Scaling, and Trilateration, with Applications to Manifold Learning

10/22/2018
by   Ery Arias-Castro, et al.
0

One of the common tasks in unsupervised learning is dimensionality reduction, where the goal is to find meaningful low-dimensional structures hidden in high-dimensional data. Sometimes referred to as manifold learning, this problem is closely related to the problem of localization, which aims at embedding a weighted graph into a low-dimensional Euclidean space. Several methods have been proposed for localization, and also manifold learning. Nonetheless, the robustness property of most of them is little understood. In this paper, we obtain perturbation bounds for classical scaling and trilateration, which are then applied to derive performance bounds for Isomap, Landmark Isomap, and Maximum Variance Unfolding. A new perturbation bound for procrustes analysis plays a key role.

READ FULL TEXT
research
05/20/2016

Dimensionality Reduction on SPD Manifolds: The Emergence of Geometry-Aware Methods

Representing images and videos with Symmetric Positive Definite (SPD) ma...
research
11/26/2021

Conditional Manifold Learning

This paper addresses a problem called "conditional manifold learning", w...
research
11/13/2019

Topological Stability: a New Algorithm for Selecting The Nearest Neighbors in Non-Linear Dimensionality Reduction Techniques

In the machine learning field, dimensionality reduction is an important ...
research
02/14/2008

FINE: Fisher Information Non-parametric Embedding

We consider the problems of clustering, classification, and visualizatio...
research
06/24/2009

On landmark selection and sampling in high-dimensional data analysis

In recent years, the spectral analysis of appropriately defined kernel m...
research
08/30/2022

Embedding Functional Data: Multidimensional Scaling and Manifold Learning

We adapt concepts, methodology, and theory originally developed in the a...
research
04/27/2023

On Manifold Learning in Plato's Cave: Remarks on Manifold Learning and Physical Phenomena

Many techniques in machine learning attempt explicitly or implicitly to ...

Please sign up or login with your details

Forgot password? Click here to reset