An Entropy Weighted Nonnegative Matrix Factorization Algorithm for Feature Representation

11/27/2021
by   Jiao Wei, et al.
0

Nonnegative matrix factorization (NMF) has been widely used to learn low-dimensional representations of data. However, NMF pays the same attention to all attributes of a data point, which inevitably leads to inaccurate representation. For example, in a human-face data set, if an image contains a hat on the head, the hat should be removed or the importance of its corresponding attributes should be decreased during matrix factorizing. This paper proposes a new type of NMF called entropy weighted NMF (EWNMF), which uses an optimizable weight for each attribute of each data point to emphasize their importance. This process is achieved by adding an entropy regularizer to the cost function and then using the Lagrange multiplier method to solve the problem. Experimental results with several data sets demonstrate the feasibility and effectiveness of the proposed method. We make our code available at https://github.com/Poisson-EM/Entropy-weighted-NMF.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 9

page 10

page 11

research
06/07/2022

Adaptive Weighted Nonnegative Matrix Factorization for Robust Feature Representation

Nonnegative matrix factorization (NMF) has been widely used to dimension...
research
04/18/2022

Subspace Nonnegative Matrix Factorization for Feature Representation

Traditional nonnegative matrix factorization (NMF) learns a new feature ...
research
04/11/2012

Robust Nonnegative Matrix Factorization via L_1 Norm Regularization

Nonnegative Matrix Factorization (NMF) is a widely used technique in man...
research
09/07/2020

Fast and Secure Distributed Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) has been successfully applied in ...
research
09/28/2022

Supervised Class-pairwise NMF for Data Representation and Classification

Various Non-negative Matrix factorization (NMF) based methods add new te...
research
05/27/2014

Supervised Dictionary Learning by a Variational Bayesian Group Sparse Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) with group sparsity constraints i...
research
01/22/2015

Bi-Objective Nonnegative Matrix Factorization: Linear Versus Kernel-Based Models

Nonnegative matrix factorization (NMF) is a powerful class of feature ex...

Please sign up or login with your details

Forgot password? Click here to reset