On Uniform Consistency of Spectral Embeddings

04/25/2023
by   Ruofei Zhao, et al.
0

In this paper, we study the convergence of the spectral embeddings obtained from the leading eigenvectors of certain similarity matrices to their population counterparts. We opt to study this convergence in a uniform (instead of average) sense and highlight the benefits of this choice. Using the Newton-Kantorovich Theorem and other tools from functional analysis, we first establish a general perturbation result for orthonormal bases of invariant subspaces. We then apply this general result to normalized spectral clustering. By tapping into the rich literature of Sobolev spaces and exploiting some concentration results in Hilbert spaces, we are able to prove a finite sample error bound on the uniform consistency error of the spectral embeddings in normalized spectral clustering.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2015

A variational approach to the consistency of spectral clustering

This paper establishes the consistency of spectral approaches to data cl...
research
10/05/2013

Role of normalization in spectral clustering for stochastic blockmodels

Spectral clustering is a technique that clusters elements using the top ...
research
04/29/2014

The geometry of kernelized spectral clustering

Clustering of data sets is a standard problem in many areas of science a...
research
03/05/2015

Spectral Clustering by Ellipsoid and Its Connection to Separable Nonnegative Matrix Factorization

This paper proposes a variant of the normalized cut algorithm for spectr...
research
10/14/2020

Refining Similarity Matrices to Cluster Attributed Networks Accurately

As a result of the recent popularity of social networks and the increase...
research
12/08/2022

A Distributed Block Chebyshev-Davidson Algorithm for Parallel Spectral Clustering

We develop a distributed Block Chebyshev-Davidson algorithm to solve lar...
research
04/30/2022

Understanding the Generalization Performance of Spectral Clustering Algorithms

The theoretical analysis of spectral clustering mainly focuses on consis...

Please sign up or login with your details

Forgot password? Click here to reset