Community detection through likelihood optimization: in search of a sound model

Community detection has recently became one of the most important problems in network analysis and many algorithms have been proposed to solve this problem. Among others, methods based on statistical inference are of particular interest: such algorithms are mathematically sound and were shown to provide partitions of good quality. The main ingredient of statistical inference methods is to assume some underlying random graph model and then fit this model to the observed graph by maximizing the likelihood. The choice of this underlying model (a.k.a. null model) is very important for such methods and this choice is the focus of the current study. We provide an extensive theoretical and empirical analysis to compare several models: the stochastic block model, which is currently the most widely used model for likelihood optimization; recently proposed degree-corrected modification of this model, and a new one-parametric null model which has some desirable statistical properties. We also develop and compare two likelihood optimization algorithms suitable for the null models under consideration. An extensive empirical analysis on a variety of datasets shows, in particular, that, in contrast to synthetic datasets, real-world networks have diverse nature and there is no model suitable for all of them.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2022

Modularity of the ABCD Random Graph Model with Community Structure

The Artificial Benchmark for Community Detection (ABCD) graph is a rando...
research
01/26/2021

Community Detection in the Stochastic Block Model by Mixed Integer Programming

The Degree-Corrected Stochastic Block Model (DCSBM) is a popular model t...
research
07/10/2018

Pairwise Covariates-adjusted Block Model for Community Detection

One of the most fundamental problems in network study is community detec...
research
11/09/2020

Community Detection by Principal Components Clustering Methods

Based on the classical Degree Corrected Stochastic Blockmodel (DCSBM) mo...
research
08/08/2023

Community Detection in Hypergraphs via Mutual Information Maximization

The hypergraph community detection problem seeks to identify groups of r...
research
05/23/2017

Community Detection with Graph Neural Networks

We study data-driven methods for community detection in graphs. This est...
research
05/02/2022

The mighty force: statistical inference and high-dimensional statistics

This is a review to appear as a contribution to the edited volume "Spin ...

Please sign up or login with your details

Forgot password? Click here to reset