On semidefinite relaxations for the block model

06/21/2014
by   Arash A. Amini, et al.
0

The stochastic block model (SBM) is a popular tool for community detection in networks, but fitting it by maximum likelihood (MLE) involves a computationally infeasible optimization problem. We propose a new semidefinite programming (SDP) solution to the problem of fitting the SBM, derived as a relaxation of the MLE. We put ours and previously proposed SDPs in a unified framework, as relaxations of the MLE over various sub-classes of the SBM, revealing a connection to sparse PCA. Our main relaxation, which we call SDP-1, is tighter than other recently proposed SDP relaxations, and thus previously established theoretical guarantees carry over. However, we show that SDP-1 exactly recovers true communities over a wider class of SBMs than those covered by current results. In particular, the assumption of strong assortativity of the SBM, implicit in consistency conditions for previously proposed SDPs, can be relaxed to weak assortativity for our approach, thus significantly broadening the class of SBMs covered by the consistency results. We also show that strong assortativity is indeed a necessary condition for exact recovery for previously proposed SDP approaches and not an artifact of the proofs. Our analysis of SDPs is based on primal-dual witness constructions, which provides some insight into the nature of the solutions of various SDPs. We show how to combine features from SDP-1 and already available SDPs to achieve the most flexibility in terms of both assortativity and block-size constraints, as our relaxation has the tendency to produce communities of similar sizes. This tendency makes it the ideal tool for fitting network histograms, a method gaining popularity in the graphon estimation literature, as we illustrate on an example of a social networks of dolphins. We also provide empirical evidence that SDPs outperform spectral methods for fitting SBMs with a large number of blocks.

READ FULL TEXT

page 17

page 19

page 21

research
07/08/2018

Stochastic Block Model for Hypergraphs: Statistical limits and a semidefinite programming approach

We study the problem of community detection in a random hypergraph model...
research
02/26/2015

Achieving Exact Cluster Recovery Threshold via Semidefinite Programming: Extensions

Resolving a conjecture of Abbe, Bandeira and Hall, the authors have rece...
research
07/10/2012

Pseudo-likelihood methods for community detection in large sparse networks

Many algorithms have been proposed for fitting network models with commu...
research
02/02/2021

Community Detection with a Subsampled Semidefinite Program

Semidefinite programming is an important tool to tackle several problems...
research
02/20/2016

Semidefinite Programs for Exact Recovery of a Hidden Community

We study a semidefinite programming (SDP) relaxation of the maximum like...
research
03/15/2016

On the exact recovery of sparse signals via conic relaxations

In this note we compare two recently proposed semidefinite relaxations f...
research
12/22/2022

Fréchet Mean Set Estimation in the Hausdorff Metric, via Relaxation

This work resolves the following question in non-Euclidean statistics: I...

Please sign up or login with your details

Forgot password? Click here to reset