Skewed Distributions or Transformations? Modelling Skewness for a Cluster Analysis

by   Michael P. B. Gallaugher, et al.

Because of its mathematical tractability, the Gaussian mixture model holds a special place in the literature for clustering and classification. For all its benefits, however, the Gaussian mixture model poses problems when the data is skewed or contains outliers. Because of this, methods have been developed over the years for handling skewed data, and fall into two general categories. The first is to consider a mixture of more flexible skewed distributions, and the second is based on incorporating a transformation to near normality. Although these methods have been compared in their respective papers, there has yet to be a detailed comparison to determine when one method might be more suitable than the other. Herein, we provide a detailed comparison on many benchmarking datasets, as well as describe a novel method to assess cluster separation.



There are no comments yet.


page 10


Cutoff for exact recovery of Gaussian mixture models

We determine the cutoff value on separation of cluster centers for exact...

Unsupervised Methods for Identifying Pass Coverage Among Defensive Backs with NFL Player Tracking Data

Analysis of player tracking data for American football is in its infancy...

Fitting A Mixture Distribution to Data: Tutorial

This paper is a step-by-step tutorial for fitting a mixture distribution...

Outlier Detection In Large-scale Traffic Data By Naïve Bayes Method and Gaussian Mixture Model Method

It is meaningful to detect outliers in traffic data for traffic manageme...

ClustRank: a Visual Quality Measure Trained on Perceptual Data for Sorting Scatterplots by Cluster Patterns

Visual quality measures (VQMs) are designed to support analysts by autom...

Petrophysically and geologically guided multi-physics inversion using a dynamic Gaussian mixture model

In a previous paper, we introduced a framework for carrying out petrophy...

A probabilistic approach to emission-line galaxy classification

We invoke a Gaussian mixture model (GMM) to jointly analyse two traditio...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.