On the Relationships between Transform-Learning NMF and Joint-Diagonalization

12/10/2021
by   Sixin Zhang, et al.
0

Non-negative matrix factorization with transform learning (TL-NMF) is a recent idea that aims at learning data representations suited to NMF. In this work, we relate TL-NMF to the classical matrix joint-diagonalization (JD) problem. We show that, when the number of data realizations is sufficiently large, TL-NMF can be replaced by a two-step approach – termed as JD+NMF – that estimates the transform through JD, prior to NMF computation. In contrast, we found that when the number of data realizations is limited, not only is JD+NMF no longer equivalent to TL-NMF, but the inherent low-rank constraint of TL-NMF turns out to be an essential ingredient to learn meaningful transforms for NMF.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/16/2018

A particle-based variational approach to Bayesian Non-negative Matrix Factorization

Bayesian Non-negative Matrix Factorization (NMF) is a promising approach...
research
11/06/2018

A Quasi-Newton algorithm on the orthogonal manifold for NMF with transform learning

Nonnegative matrix factorization (NMF) is a popular method for audio spe...
research
12/18/2013

Permuted NMF: A Simple Algorithm Intended to Minimize the Volume of the Score Matrix

Non-Negative Matrix Factorization, NMF, attempts to find a number of arc...
research
09/21/2017

Deep Recurrent NMF for Speech Separation by Unfolding Iterative Thresholding

In this paper, we propose a novel recurrent neural network architecture ...
research
06/25/2017

There and Back Again: A General Approach to Learning Sparse Models

We propose a simple and efficient approach to learning sparse models. Ou...
research
01/17/2020

Neighborhood Structure Assisted Non-negative Matrix Factorization and its Application in Unsupervised Point Anomaly Detection

Dimensionality reduction is considered as an important step for ensuring...
research
04/02/2021

Constrained non-negative matrix factorization enabling real-time insights of in situ and high-throughput experiments

Non-negative Matrix Factorization (NMF) methods offer an appealing unsup...

Please sign up or login with your details

Forgot password? Click here to reset