Constrained Optimization for a Subset of the Gaussian Parsimonious Clustering Models

06/25/2013
by   Ryan P. Browne, et al.
0

The expectation-maximization (EM) algorithm is an iterative method for finding maximum likelihood estimates when data are incomplete or are treated as being incomplete. The EM algorithm and its variants are commonly used for parameter estimation in applications of mixture models for clustering and classification. This despite the fact that even the Gaussian mixture model likelihood surface contains many local maxima and is singularity riddled. Previous work has focused on circumventing this problem by constraining the smallest eigenvalue of the component covariance matrices. In this paper, we consider constraining the smallest eigenvalue, the largest eigenvalue, and both the smallest and largest within the family setting. Specifically, a subset of the GPCM family is considered for model-based clustering, where we use a re-parameterized version of the famous eigenvalue decomposition of the component covariance matrices. Our approach is illustrated using various experiments with simulated and real data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/23/2013

A Variational Approximations-DIC Rubric for Parameter Estimation and Mixture Model Selection Within a Family Setting

Mixture model-based clustering has become an increasingly popular data a...
research
10/31/2018

An Evolutionary Algorithm with Crossover and Mutation for Model-Based Clustering

The expectation-maximization (EM) algorithm is almost ubiquitous for par...
research
07/04/2023

Algorithme EM régularisé

Expectation-Maximization (EM) algorithm is a widely used iterative algor...
research
12/19/2022

A note on the smallest eigenvalue of the empirical covariance of causal Gaussian processes

We present a simple proof for bounding the smallest eigenvalue of the em...
research
02/22/2023

Improving Model Choice in Classification: An Approach Based on Clustering of Covariance Matrices

This work introduces a refinement of the Parsimonious Model for fitting ...
research
02/01/2019

Challenges with EM in application to weakly identifiable mixture models

We study a class of weakly identifiable location-scale mixture models fo...
research
08/18/2023

Phase transition for the smallest eigenvalue of covariance matrices

In this paper, we study the smallest non-zero eigenvalue of the sample c...

Please sign up or login with your details

Forgot password? Click here to reset