Kernelized Diffusion maps

02/13/2023
by   Loucas Pillaud-Vivien, et al.
0

Spectral clustering and diffusion maps are celebrated dimensionality reduction algorithms built on eigen-elements related to the diffusive structure of the data. The core of these procedures is the approximation of a Laplacian through a graph kernel approach, however this local average construction is known to be cursed by the high-dimension d. In this article, we build a different estimator of the Laplacian, via a reproducing kernel Hilbert space method, which adapts naturally to the regularity of the problem. We provide non-asymptotic statistical rates proving that the kernel estimator we build can circumvent the curse of dimensionality. Finally we discuss techniques (Nyström subsampling, Fourier features) that enable to reduce the computational cost of the estimator while not degrading its overall performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/19/2013

Making Laplacians commute

In this paper, we construct multimodal spectral geometry by finding a pa...
research
06/10/2019

A Unified Definition and Computation of Laplacian Spectral Distances

Laplacian spectral kernels and distances (e.g., biharmonic, heat diffusi...
research
09/11/2012

Multimodal diffusion geometry by joint diagonalization of Laplacians

We construct an extension of diffusion geometry to multiple modalities t...
research
06/12/2023

G-invariant diffusion maps

The diffusion maps embedding of data lying on a manifold have shown succ...
research
03/12/2016

Laplacian Eigenmaps from Sparse, Noisy Similarity Measurements

Manifold learning and dimensionality reduction techniques are ubiquitous...
research
10/28/2019

The spectral dimension of simplicial complexes: a renormalization group theory

Simplicial complexes are increasingly used to study complex system struc...
research
09/09/2018

Clustering of graph vertex subset via Krylov subspace model reduction

Clustering via graph-Laplacian spectral imbedding is ubiquitous in data ...

Please sign up or login with your details

Forgot password? Click here to reset