The Mathematical Foundations of Manifold Learning

10/30/2020
by   Luke Melas-Kyriazi, et al.
0

Manifold learning is a popular and quickly-growing subfield of machine learning based on the assumption that one's observed data lie on a low-dimensional manifold embedded in a higher-dimensional space. This thesis presents a mathematical perspective on manifold learning, delving into the intersection of kernel learning, spectral graph theory, and differential geometry. Emphasis is placed on the remarkable interplay between graphs and manifolds, which forms the foundation for the widely-used technique of manifold regularization. This work is written to be accessible to a broad mathematical audience, including machine learning researchers and practitioners interested in understanding the theorems underlying popular manifold learning algorithms and dimensionality reduction techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/17/2017

S-Isomap++: Multi Manifold Learning from Streaming Data

Manifold learning based methods have been widely used for non-linear dim...
research
06/13/2020

Sample complexity and effective dimension for regression on manifolds

We consider the theory of regression on a manifold using reproducing ker...
research
04/27/2023

On Manifold Learning in Plato's Cave: Remarks on Manifold Learning and Physical Phenomena

Many techniques in machine learning attempt explicitly or implicitly to ...
research
07/14/2021

MESS: Manifold Embedding Motivated Super Sampling

Many approaches in the field of machine learning and data analysis rely ...
research
05/07/2021

Kernel MMD Two-Sample Tests for Manifold Data

We present a study of kernel MMD two-sample test statistics in the manif...
research
10/13/2022

Dissipative residual layers for unsupervised implicit parameterization of data manifolds

We propose an unsupervised technique for implicit parameterization of da...
research
08/19/2022

IAN: Iterated Adaptive Neighborhoods for manifold learning and dimensionality estimation

Invoking the manifold assumption in machine learning requires knowledge ...

Please sign up or login with your details

Forgot password? Click here to reset