The Mathematics Behind Spectral Clustering And The Equivalence To PCA

03/01/2021
by   T. Shen, et al.
0

Spectral clustering is a popular algorithm that clusters points using the eigenvalues and eigenvectors of Laplacian matrices derived from the data. For years, spectral clustering has been working mysteriously. This paper explains spectral clustering by dividing it into two categories based on whether the graph Laplacian is fully connected or not. For a fully connected graph, this paper demonstrates the dimension reduction part by offering an objective function: the covariance between the original data points' similarities and the mapped data points' similarities. For a multi-connected graph, this paper proves that with a proper k, the first k eigenvectors are the indicators of the connected components. This paper also proves there is an equivalence between spectral embedding and PCA.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

01/05/2017

Signed Laplacian for spectral clustering revisited

Classical spectral clustering is based on a spectral decomposition of a ...
01/04/2018

SpectralNet: Spectral Clustering using Deep Neural Networks

Spectral clustering is a leading and popular technique in unsupervised d...
02/18/2022

Linearization and Identification of Multiple-Attractors Dynamical System through Laplacian Eigenmaps

Dynamical Systems (DS) are fundamental to the modeling and understanding...
01/09/2013

Spectral Clustering Based on Local PCA

We propose a spectral clustering method based on local principal compone...
02/11/2010

Operator norm convergence of spectral clustering on level sets

Following Hartigan, a cluster is defined as a connected component of the...
06/07/2020

Unsupervised Learning for Subterranean Junction Recognition Based on 2D Point Cloud

This article proposes a novel unsupervised learning framework for detect...
01/30/2019

Geometric structure of graph Laplacian embeddings

We analyze the spectral clustering procedure for identifying coarse stru...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.