Phase Transitions and a Model Order Selection Criterion for Spectral Graph Clustering

04/11/2016
by   Pin-Yu Chen, et al.
0

One of the longstanding open problems in spectral graph clustering (SGC) is the so-called model order selection problem: automated selection of the correct number of clusters. This is equivalent to the problem of finding the number of connected components or communities in an undirected graph. We propose automated model order selection (AMOS), a solution to the SGC model selection problem under a random interconnection model (RIM) using a novel selection criterion that is based on an asymptotic phase transition analysis. AMOS can more generally be applied to discovering hidden block diagonal structure in symmetric non-negative matrices. Numerical experiments on simulated graphs validate the phase transition analysis, and real-world network data is used to validate the performance of the proposed model selection procedure.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2016

AMOS: An Automated Model Order Selection Algorithm for Spectral Graph Clustering

One of the longstanding problems in spectral graph clustering (SGC) is t...
research
06/24/2014

Automatic Dimension Selection for a Non-negative Factorization Approach to Clustering Multiple Random Graphs

We consider a problem of grouping multiple graphs into several clusters ...
research
04/05/2019

Simultaneous Dimensionality and Complexity Model Selection for Spectral Graph Clustering

Our problem of interest is to cluster vertices of a graph by identifying...
research
12/29/2013

A model selection approach for clustering a multinomial sequence with non-negative factorization

We consider a problem of clustering a sequence of multinomial observatio...
research
04/06/2022

Fundamental limits to learning closed-form mathematical models from data

Given a finite and noisy dataset generated with a closed-form mathematic...
research
03/26/2016

Reconstructing undirected graphs from eigenspaces

In this paper, we aim at recovering an undirected weighted graph of N ve...
research
08/17/2023

Universal and Automatic Elbow Detection for Learning the Effective Number of Components in Model Selection Problems

We design a Universal Automatic Elbow Detector (UAED) for deciding the e...

Please sign up or login with your details

Forgot password? Click here to reset