Achieving the Bayes Error Rate in Synchronization and Block Models by SDP, Robustly

04/21/2019
by   Yingjie Fei, et al.
0

We study the statistical performance of semidefinite programming (SDP) relaxations for clustering under random graph models. Under the Z_2 Synchronization model, Censored Block Model and Stochastic Block Model, we show that SDP achieves an error rate of the form [-(1-o(1))n̅ I^* ]. Here n̅ is an appropriate multiple of the number of nodes and I^* is an information-theoretic measure of the signal-to-noise ratio. We provide matching lower bounds on the Bayes error for each model and therefore demonstrate that the SDP approach is Bayes optimal. As a corollary, our results imply that SDP achieves the optimal exact recovery threshold under each model. Furthermore, we show that SDP is robust: the above bound remains valid under semirandom versions of the models in which the observed graph is modified by a monotone adversary. Our proof is based on a novel primal-dual analysis of SDP under a unified framework for all three models, and the analysis shows that SDP tightly approximates a joint majority voting procedure.

READ FULL TEXT
research
05/23/2017

Exponential error rates of SDP for block models: Beyond Grothendieck's inequality

In this paper we consider the cluster estimation problem under the Stoch...
research
12/11/2020

A New Bound on Approximate Support Recovery

Orthogonal matching pursuit (OMP) is a greedy algorithm popularly being ...
research
12/29/2018

Non-Asymptotic Chernoff Lower Bound and Its Application to Community Detection in Stochastic Block Model

Chernoff coefficient is an upper bound of Bayes error probability in cla...
research
07/25/2022

Minimax Rates for Robust Community Detection

In this work, we study the problem of community detection in the stochas...
research
12/28/2021

Non-Convex Joint Community Detection and Group Synchronization via Generalized Power Method

This paper proposes a Generalized Power Method (GPM) to tackle the probl...
research
05/21/2023

When are ensembles really effective?

Ensembling has a long history in statistical data analysis, with many im...

Please sign up or login with your details

Forgot password? Click here to reset