Gaussian Mixture Models with Component Means Constrained in Pre-selected Subspaces

08/26/2015
by   Mu Qiao, et al.
0

We investigate a Gaussian mixture model (GMM) with component means constrained in a pre-selected subspace. Applications to classification and clustering are explored. An EM-type estimation algorithm is derived. We prove that the subspace containing the component means of a GMM with a common covariance matrix also contains the modes of the density and the class means. This motivates us to find a subspace by applying weighted principal component analysis to the modes of a kernel density and the class means. To circumvent the difficulty of deciding the kernel bandwidth, we acquire multiple subspaces from the kernel densities based on a sequence of bandwidths. The GMM constrained by each subspace is estimated; and the model yielding the maximum likelihood is chosen. A dimension reduction property is proved in the sense of being informative for classification or clustering. Experiments on real and simulated data sets are conducted to examine several ways of determining the subspace and to compare with the reduced rank mixture discriminant analysis (MDA). Our new method with the simple technique of spanning the subspace only by class means often outperforms the reduced rank MDA when the subspace dimension is very low, making it particularly appealing for visualization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/20/2011

VC dimension of ellipsoids

We will establish that the VC dimension of the class of d-dimensional el...
research
08/07/2015

Dimension reduction for model-based clustering

We introduce a dimension reduction method for visualizing the clustering...
research
06/22/2021

Modal clustering on PPGMMGA projection subspace

PPGMMGA is a Projection Pursuit (PP) algorithm aimed at detecting and vi...
research
05/04/2020

How many modes can a constrained Gaussian mixture have?

We show, by an explicit construction, that a mixture of univariate Gauss...
research
08/28/2013

Clustering, Classification, Discriminant Analysis, and Dimension Reduction via Generalized Hyperbolic Mixtures

A method for dimension reduction with clustering, classification, or dis...
research
07/15/2023

Corrected kernel principal component analysis for model structural change detection

This paper develops a method to detect model structural changes by apply...
research
07/12/2018

Turning Big data into tiny data: Constant-size coresets for k-means, PCA and projective clustering

We develop and analyze a method to reduce the size of a very large set o...

Please sign up or login with your details

Forgot password? Click here to reset