Characterizing and comparing external measures for the assessment of cluster analysis and community detection

02/01/2021
by   Nejat Arinik, et al.
4

In the context of cluster analysis and graph partitioning, many external evaluation measures have been proposed in the literature to compare two partitions of the same set. This makes the task of selecting the most appropriate measure for a given situation a challenge for the end user. However, this issue is overlooked in the literature. Researchers tend to follow tradition and use the standard measures of their field, although they often became standard only because previous researchers started consistently using them. In this work, we propose a new empirical evaluation framework to solve this issue, and help the end user selecting an appropriate measure for their application. For a collection of candidate measures, it first consists in describing their behavior by computing them for a generated dataset of partitions, obtained by applying a set of predefined parametric partition transformations. Second, our framework performs a regression analysis to characterize the measures in terms of how they are affected by these parameters and transformations. This allows both describing and comparing the measures. Our approach is not tied to any specific measure or application, so it can be applied to any situation. We illustrate its relevance by applying it to a selection of standard measures, and show how it can be put in practice through two concrete use cases.

READ FULL TEXT

page 16

page 19

page 25

page 26

research
03/30/2023

An evaluation framework for comparing epidemic intelligence systems

In the context of Epidemic Intelligence, many Event-Based Surveillance (...
research
03/02/2020

How to choose the most appropriate centrality measure?

We propose a new method to select the most appropriate network centralit...
research
12/27/2022

Range-Based Set Reconciliation

Range-based set reconciliation is a simple approach to efficiently compu...
research
06/29/2018

Comparing Graph Clusterings: Set partition measures vs. Graph-aware measures

In this paper, we propose a family of graph partition similarity measure...
research
08/22/2021

The Exploitation of Distance Distributions for Clustering

Although distance measures are used in many machine learning algorithms,...
research
11/28/2009

An axiomatic approach to the roughness measure of rough sets

In Pawlak's rough set theory, a set is approximated by a pair of lower a...
research
05/15/2021

Characterizing the Interactions Between Classical and Community-aware Centrality Measures in Complex Networks

Identifying vital nodes in networks exhibiting a community structure is ...

Please sign up or login with your details

Forgot password? Click here to reset