Entropy Minimizing Matrix Factorization

03/24/2021
by   Mulin Chen, et al.
0

Nonnegative Matrix Factorization (NMF) is a widely-used data analysis technique, and has yielded impressive results in many real-world tasks. Generally, existing NMF methods represent each sample with several centroids, and find the optimal centroids by minimizing the sum of the approximation errors. However, the outliers deviating from the normal data distribution may have large residues, and then dominate the objective value seriously. In this study, an Entropy Minimizing Matrix Factorization framework (EMMF) is developed to tackle the above problem. Considering that the outliers are usually much less than the normal samples, a new entropy loss function is established for matrix factorization, which minimizes the entropy of the residue distribution and allows a few samples to have large approximation errors. In this way, the outliers do not affect the approximation of the normal samples. The multiplicative updating rules for EMMF are also designed, and the convergence is proved both theoretically and experimentally. In addition, a Graph regularized version of EMMF (G-EMMF) is also presented to deal with the complex data structure. Clustering results on various synthetic and real-world datasets demonstrate the reasonableness of the proposed models, and the effectiveness is also verified through the comparison with the state-of-the-arts.

READ FULL TEXT
research
09/06/2022

Rethinking Symmetric Matrix Factorization: A More General and Better Clustering Perspective

Nonnegative matrix factorization (NMF) is widely used for clustering wit...
research
06/07/2022

Adaptive Weighted Nonnegative Matrix Factorization for Robust Feature Representation

Nonnegative matrix factorization (NMF) has been widely used to dimension...
research
06/02/2019

Truncated Cauchy Non-negative Matrix Factorization

Non-negative matrix factorization (NMF) minimizes the Euclidean distance...
research
04/10/2016

Online Nonnegative Matrix Factorization with Outliers

We propose a unified and systematic framework for performing online nonn...
research
08/07/2020

Nyström Approximation with Nonnegative Matrix Factorization

Motivated by the needs of estimating the proximity clustering with parti...
research
04/18/2022

Subspace Nonnegative Matrix Factorization for Feature Representation

Traditional nonnegative matrix factorization (NMF) learns a new feature ...
research
10/19/2017

Efficient Robust Matrix Factorization with Nonconvex Penalties

Robust matrix factorization (RMF) is a fundamental tool with lots of app...

Please sign up or login with your details

Forgot password? Click here to reset