Provable Estimation of the Number of Blocks in Block Models

05/24/2017
by   Bowei Yan, et al.
0

Community detection is a fundamental unsupervised learning problem for unlabeled networks which has a broad range of applications. Many community detection algorithms assume that the number of clusters r is known apriori. In this paper, we propose an approach based on semi-definite relaxation, which recovers the number of clusters and the clustering matrix exactly under a broad parameter regime, with probability tending to one. Compared to existing convex relaxations, our relaxation leads to exact recovery under weaker conditions on cluster separation or cluster sizes. On a variety of simulated and real data experiments, we show that the proposed method often outperforms state-of-the-art techniques for estimating the number of clusters.

READ FULL TEXT

page 7

page 8

research
02/26/2015

Achieving Exact Cluster Recovery Threshold via Semidefinite Programming: Extensions

Resolving a conjecture of Abbe, Bandeira and Hall, the authors have rece...
research
11/04/2021

Community detection in censored hypergraph

Community detection refers to the problem of clustering the nodes of a n...
research
08/23/2022

Community Detection in the Hypergraph SBM: Optimal Recovery Given the Similarity Matrix

Community detection is a fundamental problem in network science. In this...
research
08/30/2017

A Compressive Sensing Approach to Community Detection with Applications

The community detection problem for graphs asks one to partition the n v...
research
10/20/2015

Optimal Cluster Recovery in the Labeled Stochastic Block Model

We consider the problem of community detection or clustering in the labe...
research
09/30/2018

Convex Relaxation Methods for Community Detection

This paper surveys recent theoretical advances in convex optimization ap...
research
09/15/2022

Selecting a significance level in sequential testing procedures for community detection

While there have been numerous sequential algorithms developed to estima...

Please sign up or login with your details

Forgot password? Click here to reset