Computational Lower Bounds for Graphon Estimation via Low-degree Polynomials

08/30/2023
by   Yuetian Luo, et al.
0

Graphon estimation has been one of the most fundamental problems in network analysis and has received considerable attention in the past decade. From the statistical perspective, the minimax error rate of graphon estimation has been established by Gao et al (2015) for both stochastic block model (SBM) and nonparametric graphon estimation. The statistical optimal estimators are based on constrained least squares and have computational complexity exponential in the dimension. From the computational perspective, the best-known polynomial-time estimator is based on universal singular value thresholding (USVT), but it can only achieve a much slower estimation error rate than the minimax one. It is natural to wonder if such a gap is essential. The computational optimality of the USVT or the existence of a computational barrier in graphon estimation has been a long-standing open problem. In this work, we take the first step towards it and provide rigorous evidence for the computational barrier in graphon estimation via low-degree polynomials. Specifically, in both SBM and nonparametric graphon estimation, we show that for low-degree polynomial estimators, their estimation error rates cannot be significantly better than that of the USVT under a wide range of parameter regimes. Our results are proved based on the recent development of low-degree polynomials by Schramm and Wein (2022), while we overcome a few key challenges in applying it to the general graphon estimation problem. By leveraging our main results, we also provide a computational lower bound on the clustering error for community detection in SBM with a growing number of communities and this yields a new piece of evidence for the conjectured Kesten-Stigum threshold for efficient community recovery.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/30/2017

Bayesian estimation from few samples: community detection and related problems

We propose an efficient meta-algorithm for Bayesian estimation problems ...
research
08/05/2020

Computational Barriers to Estimation from Low-Degree Polynomials

One fundamental goal of high-dimensional statistics is to detect or reco...
research
09/10/2017

Rates of Convergence of Spectral Methods for Graphon Estimation

This paper studies the problem of estimating the grahpon model - the und...
research
09/14/2021

Reconstruction on Trees and Low-Degree Polynomials

The study of Markov processes and broadcasting on trees has deep connect...
research
05/21/2020

Computationally efficient sparse clustering

We study statistical and computational limits of clustering when the mea...
research
11/08/2021

Smooth tensor estimation with unknown permutations

We consider the problem of structured tensor denoising in the presence o...
research
04/04/2020

Learning with Semi-Definite Programming: new statistical bounds based on fixed point analysis and excess risk curvature

Many statistical learning problems have recently been shown to be amenab...

Please sign up or login with your details

Forgot password? Click here to reset