A Neural Network for Determination of Latent Dimensionality in Nonnegative Matrix Factorization

06/22/2020
by   Benjamin T. Nebgen, et al.
0

Non-negative Matrix Factorization (NMF) has proven to be a powerful unsupervised learning method for uncovering hidden features in complex and noisy data sets with applications in data mining, text recognition, dimension reduction, face recognition, anomaly detection, blind source separation, and many other fields. An important input for NMF is the latent dimensionality of the data, that is, the number of hidden features, K, present in the explored data set. Unfortunately, this quantity is rarely known a priori. We utilize a supervised machine learning approach in combination with a recent method for model determination, called NMFk, to determine the number of hidden features automatically. NMFk performs a set of NMF simulations on an ensemble of matrices, obtained by bootstrapping the initial data set, and determines which K produces stable groups of latent features that reconstruct the initial data set well. We then train a Multi-Layer Perceptron (MLP) classifier network to determine the correct number of latent features utilizing the statistics and characteristics of the NMF solutions, obtained from NMFk. In order to train the MLP classifier, a training set of 58,660 matrices with predetermined latent features were factorized with NMFk. The MLP classifier in conjunction with NMFk maintains a greater than 95 Additionally, when applied to two well-known benchmark data sets, the swimmer and MIT face data, NMFk/MLP correctly recovered the established number of hidden features. Finally, we compared the accuracy of our method to the ARD, AIC and Stability-based methods.

READ FULL TEXT
research
08/09/2023

Multi-modal Multi-view Clustering based on Non-negative Matrix Factorization

By combining related objects, unsupervised machine learning techniques a...
research
05/01/2015

Monotonous (Semi-)Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) factorizes a non-negative matrix ...
research
02/19/2022

Distributed Out-of-Memory NMF of Dense and Sparse Data on CPU/GPU Architectures with Automatic Model Selection for Exascale Data

The need for efficient and scalable big-data analytics methods is more e...
research
07/25/2017

A Unified Joint Matrix Factorization Framework for Data Integration

Nonnegative matrix factorization (NMF) is a powerful tool in data explor...
research
10/23/2018

Model Selection for Nonnegative Matrix Factorization by Support Union Recovery

Nonnegative matrix factorization (NMF) has been widely used in machine l...
research
07/28/2017

Sparse Deep Nonnegative Matrix Factorization

Nonnegative matrix factorization is a powerful technique to realize dime...
research
05/26/2015

Sequential Dimensionality Reduction for Extracting Localized Features

Linear dimensionality reduction techniques are powerful tools for image ...

Please sign up or login with your details

Forgot password? Click here to reset