Spectral graph clustering via the Expectation-Solution algorithm

03/30/2020
by   Zachary M. Pisano, et al.
0

The stochastic blockmodel (SBM) models the connectivity within and between disjoint subsets of nodes in networks. Prior work demonstrated that the rows of an SBM's adjacency spectral embedding (ASE) and Laplacian spectral embedding (LSE) both converge in law to Gaussian mixtures where the components are curved exponential families. Maximum likelihood estimation via the Expectation-Maximization (EM) algorithm for a full Gaussian mixture model (GMM) can then perform the task of clustering graph nodes, albeit without appealing to the components' curvature. Noting that EM is a special case of the Expectation-Solution (ES) algorithm, we propose two ES algorithms that allow us to take full advantage of these curved structures. After presenting the ES algorithm for the general curved-Gaussian mixture, we develop those corresponding to the ASE and LSE limiting distributions. Simulating from artificial SBMs and a brain connectome SBM reveals that clustering graph nodes via our ES algorithms improves upon that of EM for a full GMM.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/19/2019

Quantum Expectation-Maximization for Gaussian Mixture Models

The Expectation-Maximization (EM) algorithm is a fundamental tool in uns...
research
08/19/2019

Quantum Expectation-Maximization Algorithm

Clustering algorithms are a cornerstone of machine learning applications...
research
07/28/2022

Online Inference for Mixture Model of Streaming Graph Signals with Non-White Excitation

This paper considers a joint multi-graph inference and clustering proble...
research
05/03/2021

Spectral clustering under degree heterogeneity: a case for the random walk Laplacian

This paper shows that graph spectral embedding using the random walk Lap...
research
12/02/2018

GAN-EM: GAN based EM learning framework

Expectation maximization (EM) algorithm is to find maximum likelihood so...
research
09/04/2015

EM Algorithms for Weighted-Data Clustering with Application to Audio-Visual Scene Analysis

Data clustering has received a lot of attention and numerous methods, al...
research
10/24/2017

Distributed estimation from relative measurements of heterogeneous and uncertain quality

This paper studies the problem of estimation from relative measurements ...

Please sign up or login with your details

Forgot password? Click here to reset