Inferring Hidden Structures in Random Graphs

10/05/2021
by   Wasim Huleihel, et al.
0

We study the two inference problems of detecting and recovering an isolated community of general structure planted in a random graph. The detection problem is formalized as a hypothesis testing problem, where under the null hypothesis, the graph is a realization of an Erdős-Rényi random graph 𝒢(n,q) with edge density q∈(0,1); under the alternative, there is an unknown structure Γ_k on k nodes, planted in 𝒢(n,q), such that it appears as an induced subgraph. In case of a successful detection, we are concerned with the task of recovering the corresponding structure. For these problems, we investigate the fundamental limits from both the statistical and computational perspectives. Specifically, we derive lower bounds for detecting/recovering the structure Γ_k in terms of the parameters (n,k,q), as well as certain properties of Γ_k, and exhibit computationally unbounded optimal algorithms that achieve these lower bounds. We also consider the problem of testing in polynomial-time. As is customary in many similar structured high-dimensional problems, our model undergoes an "easy-hard-impossible" phase transition and computational constraints can severely penalize the statistical performance. To provide an evidence for this phenomenon, we show that the class of low-degree polynomials algorithms match the statistical performance of the polynomial-time algorithms we develop.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2022

Is it easier to count communities than find them?

Random graph models with community structure have been studied extensive...
research
06/11/2023

Detection and Recovery of Hidden Submatrices

In this paper, we study the problems of detection and recovery of hidden...
research
12/07/2021

Lattice-Based Methods Surpass Sum-of-Squares in Clustering

Clustering is a fundamental primitive in unsupervised learning which giv...
research
09/21/2018

High Temperature Structure Detection in Ferromagnets

This paper studies structure detection problems in high temperature ferr...
research
12/30/2015

Sharp Computational-Statistical Phase Transitions via Oracle Computational Model

We study the fundamental tradeoffs between computational tractability an...
research
06/25/2014

Computational Lower Bounds for Community Detection on Random Graphs

This paper studies the problem of detecting the presence of a small dens...
research
01/01/2018

Statistical and Computational Limits for Sparse Matrix Detection

This paper investigates the fundamental limits for detecting a high-dime...

Please sign up or login with your details

Forgot password? Click here to reset