Parsimonious Model-Based Clustering with Covariates

11/15/2017
by   Keefe Murphy, et al.
0

In model-based clustering methods using finite mixture models, the clustering is implemented on the outcome variables only and reference is not made to the associated covariates until the structure of the clustering is investigated in light of the information present in the covariates. It is desirable to have these covariates incorporated into the clustering process and not only into the interpretation of the clustering structure and model parameters, in order to exploit clustering capabilities and provide richer insight into the type of observation which characterises each cluster. The mixture of experts model provides such a framework: it extends the mixture model to accommodate the presence of covariates by modelling the parameters of the mixture model as functions of the concomitant variables. However, parsimonious parameterisations of the component covariance matrices have to date been lacking in the mixture of experts context. We consider model-based clustering methods that account for external information available in the presence of covariates by proposing the MoEClust suite of models, which allow covariates enter the gating and/or expert networks. This paper addresses the aim of including covariates in parsimonious Gaussian finite mixture models or, equivalently, the aim of incorporating parsimonious covariance structures into the mixture of experts framework. The MoEClust models demonstrate significant improvement on both fronts in applications to univariate and multivariate data sets.

READ FULL TEXT
research
06/21/2018

Mixtures of Experts Models

Mixtures of experts models provide a framework in which covariates may b...
research
01/26/2018

Multivariate normal mixture modeling, clustering and classification with the rebmix package

The rebmix package provides R functions for random univariate and multiv...
research
04/09/2019

Bivariate Gamma Mixture of Experts Models for Joint Insurance Claims Modeling

In general insurance, risks from different categories are often modeled ...
research
07/15/2020

Mixture Complexity and Its Application to Gradual Clustering Change Detection

In model-based clustering using finite mixture models, it is a significa...
research
04/23/2019

Model based functional clustering of varved lake sediments

In this paper we propose a model-based method for clustering subjects fo...
research
07/05/2018

Model-based Clustering

Mixture models extend the toolbox of clustering methods available to the...
research
04/18/2022

A Greedy and Optimistic Approach to Clustering with a Specified Uncertainty of Covariates

In this study, we examine a clustering problem in which the covariates o...

Please sign up or login with your details

Forgot password? Click here to reset