A Survey on Surrogate Approaches to Non-negative Matrix Factorization

08/06/2018
by   Pascal Fernsel, et al.
10

Motivated by applications in hyperspectral imaging we investigate methods for approximating a high-dimensional non-negative matrix Y by a product of two lower-dimensional, non-negative matrices K and X. This so-called non-negative matrix factorization is based on defining suitable Tikhonov functionals, which combine a discrepancy measure for Y≈KX with penalty terms for enforcing additional properties of K and X. The minimization is based on alternating minimization with respect to K or X, where in each iteration step one replaces the original Tikhonov functional by a locally defined surrogate functional. The choice of surrogate functionals is crucial: It should allow a comparatively simple minimization and simultaneously its first order optimality condition should lead to multiplicative update rules, which automatically preserve non-negativity of the iterates. We review the most standard construction principles for surrogate functionals for Frobenius-norm and Kullback-Leibler discrepancy measures. We extend the known surrogate constructions by a general framework, which allows to add a large variety of penalty terms. The paper finishes by deriving the corresponding alternating minimization schemes explicitely and by applying these methods to MALDI imaging data.

READ FULL TEXT

page 27

page 28

page 29

page 30

research
04/11/2021

A Non-Negative Matrix Factorization Game

We present a novel game-theoretic formulation of Non-Negative Matrix Fac...
research
05/16/2019

Non-negative matrix factorization based on generalized dual divergence

A theoretical framework for non-negative matrix factorization based on g...
research
01/19/2017

Stochastic Subsampling for Factorizing Huge Matrices

We present a matrix-factorization algorithm that scales to input matrice...
research
09/22/2022

Non-Negative Matrix Factorization with Scale Data Structure Preservation

The model described in this paper belongs to the family of non-negative ...
research
05/18/2017

A Non-monotone Alternating Updating Method for A Class of Matrix Factorization Problems

In this paper we consider a general matrix factorization model which cov...
research
06/13/2017

Provable Alternating Gradient Descent for Non-negative Matrix Factorization with Strong Correlations

Non-negative matrix factorization is a basic tool for decomposing data i...
research
06/08/2021

Unbalanced Optimal Transport through Non-negative Penalized Linear Regression

This paper addresses the problem of Unbalanced Optimal Transport (UOT) i...

Please sign up or login with your details

Forgot password? Click here to reset