Role of normalization in spectral clustering for stochastic blockmodels

10/05/2013
by   Purnamrita Sarkar, et al.
0

Spectral clustering is a technique that clusters elements using the top few eigenvectors of their (possibly normalized) similarity matrix. The quality of spectral clustering is closely tied to the convergence properties of these principal eigenvectors. This rate of convergence has been shown to be identical for both the normalized and unnormalized variants in recent random matrix theory literature. However, normalization for spectral clustering is commonly believed to be beneficial [Stat. Comput. 17 (2007) 395-416]. Indeed, our experiments show that normalization improves prediction accuracy. In this paper, for the popular stochastic blockmodel, we theoretically show that normalization shrinks the spread of points in a class by a constant fraction under a broad parameter regime. As a byproduct of our work, we also obtain sharp deviation bounds of empirical principal eigenvalues of graphs generated from a stochastic blockmodel.

READ FULL TEXT
research
03/15/2016

Data Clustering and Graph Partitioning via Simulated Mixing

Spectral clustering approaches have led to well-accepted algorithms for ...
research
02/08/2021

EigenGame Unloaded: When playing games is better than optimizing

We build on the recently proposed EigenGame that views eigendecompositio...
research
04/25/2023

On Uniform Consistency of Spectral Embeddings

In this paper, we study the convergence of the spectral embeddings obtai...
research
02/24/2021

Two-way kernel matrix puncturing: towards resource-efficient PCA and spectral clustering

The article introduces an elementary cost and storage reduction method f...
research
03/18/2020

Tail Bounds for Matrix Quadratic Forms and Bias Adjusted Spectral Clustering in Multi-layer Stochastic Block Models

We develop tail probability bounds for matrix linear combinations with m...
research
06/08/2017

Clustering with t-SNE, provably

t-distributed Stochastic Neighborhood Embedding (t-SNE), a clustering an...
research
04/06/2023

Learning Neural Eigenfunctions for Unsupervised Semantic Segmentation

Unsupervised semantic segmentation is a long-standing challenge in compu...

Please sign up or login with your details

Forgot password? Click here to reset