Phase transition for detecting a small community in a large network

03/09/2023
by   Jiashun Jin, et al.
0

How to detect a small community in a large network is an interesting problem, including clique detection as a special case, where a naive degree-based χ^2-test was shown to be powerful in the presence of an Erdős-Renyi background. Using Sinkhorn's theorem, we show that the signal captured by the χ^2-test may be a modeling artifact, and it may disappear once we replace the Erdős-Renyi model by a broader network model. We show that the recent SgnQ test is more appropriate for such a setting. The test is optimal in detecting communities with sizes comparable to the whole network, but has never been studied for our setting, which is substantially different and more challenging. Using a degree-corrected block model (DCBM), we establish phase transitions of this testing problem concerning the size of the small community and the edge densities in small and large communities. When the size of the small community is larger than √(n), the SgnQ test is optimal for it attains the computational lower bound (CLB), the information lower bound for methods allowing polynomial computation time. When the size of the small community is smaller than √(n), we establish the parameter regime where the SgnQ test has full power and make some conjectures of the CLB. We also study the classical information lower bound (LB) and show that there is always a gap between the CLB and LB in our range of interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/25/2014

Computational Lower Bounds for Community Detection on Random Graphs

This paper studies the problem of detecting the presence of a small dens...
research
12/21/2022

Is it easier to count communities than find them?

Random graph models with community structure have been studied extensive...
research
10/02/2017

Testing for Global Network Structure Using Small Subgraph Statistics

We study the problem of testing for community structure in networks usin...
research
02/28/2013

Community Detection in Random Networks

We formalize the problem of detecting a community in a network into test...
research
10/28/2020

Combinatorial-Probabilistic Trade-Off: Community Properties Test in the Stochastic Block Models

In this paper, we propose an inferential framework testing the general c...
research
12/09/2020

Optimal distributed testing in high-dimensional Gaussian models

In this paper study the problem of signal detection in Gaussian noise in...
research
02/04/2018

Parameter estimators of random intersection graphs with thinned communities

This paper studies a statistical network model generated by a large numb...

Please sign up or login with your details

Forgot password? Click here to reset