Theoretical and Computational Guarantees of Mean Field Variational Inference for Community Detection

10/30/2017
by   Anderson Y. Zhang, et al.
0

The mean field variational Bayes method is becoming increasingly popular in statistics and machine learning. Its iterative Coordinate Ascent Variational Inference algorithm has been widely applied to large scale Bayesian inference. See Blei et al. (2017) for a recent comprehensive review. Despite the popularity of the mean field method there exist remarkably little fundamental theoretical justifications. To the best of our knowledge, the iterative algorithm has never been investigated for any high dimensional and complex model. In this paper, we study the mean field method for community detection under the Stochastic Block Model. For an iterative Batch Coordinate Ascent Variational Inference algorithm, we show that it has a linear convergence rate and converges to the minimax rate within n iterations. This complements the results of Bickel et al. (2013) which studied the global minimum of the mean field variational Bayes and obtained asymptotic normal estimation of global model parameters. In addition, we obtain similar optimality results for Gibbs sampling and an iterative procedure to calculate maximum likelihood estimation, which can be of independent interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2019

When random initializations help: a study of variational inference for community detection

Variational approximation has been widely used in large-scale Bayesian i...
research
11/05/2021

Optimality of variational inference for stochastic block model with missing links

Variational methods are extremely popular in the analysis of network dat...
research
01/12/2023

Variational Inference: Posterior Threshold Improves Network Clustering Accuracy in Sparse Regimes

Variational inference has been widely used in machine learning literatur...
research
07/29/2019

A Theoretical Case Study of Structured Variational Inference for Community Detection

Mean-field variational inference (MFVI) has been widely applied in large...
research
09/29/2022

Structured Optimal Variational Inference for Dynamic Latent Space Models

We consider a latent space model for dynamic networks, where our objecti...
research
07/13/2020

Dynamics of coordinate ascent variational inference: A case study in 2D Ising models

Variational algorithms have gained prominence over the past two decades ...

Please sign up or login with your details

Forgot password? Click here to reset