Percolated stochastic block model via EM algorithm and belief propagation with non-backtracking spectra

07/31/2023
by   Marianna Bolla, et al.
0

Whereas Laplacian and modularity based spectral clustering is apt to dense graphs, recent results show that for sparse ones, the non-backtracking spectrum is the best candidate to find assortative clusters of nodes. Here belief propagation in the sparse stochastic block model is derived with arbitrary given model parameters that results in a non-linear system of equations; with linear approximation, the spectrum of the non-backtracking matrix is able to specify the number k of clusters. Then the model parameters themselves can be estimated by the EM algorithm. Bond percolation in the assortative model is considered in the following two senses: the within- and between-cluster edge probabilities decrease with the number of nodes and edges coming into existence in this way are retained with probability β. As a consequence, the optimal k is the number of the structural real eigenvalues (greater than √(c), where c is the average degree) of the non-backtracking matrix of the graph. Assuming, these eigenvalues μ_1 >… > μ_k are distinct, the multiple phase transitions obtained for β are β_i =c/μ_i^2; further, at β_i the number of detectable clusters is i, for i=1,… ,k. Inflation-deflation techniques are also discussed to classify the nodes themselves, which can be the base of the sparse spectral clustering.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2013

Spectral redemption: clustering sparse networks

Spectral algorithms are classic approaches to clustering and community d...
research
12/20/2021

Regularity based spectral clustering and mapping the Fiedler-carpet

Spectral clustering is discussed from many perspectives, by extending it...
research
07/29/2022

Stochastic Parallelizable Eigengap Dilation for Large Graph Clustering

Large graphs commonly appear in social networks, knowledge graphs, recom...
research
06/17/2021

On the training of sparse and dense deep neural networks: less parameters, same performance

Deep neural networks can be trained in reciprocal space, by acting on th...
research
04/25/2011

Clustering Partially Observed Graphs via Convex Optimization

This paper considers the problem of clustering a partially observed unwe...
research
09/10/2015

Density Evolution in the Degree-correlated Stochastic Block Model

There is a recent surge of interest in identifying the sharp recovery th...
research
07/24/2020

Scaling Graph Clustering with Distributed Sketches

The unsupervised learning of community structure, in particular the part...

Please sign up or login with your details

Forgot password? Click here to reset