Multiplicative Updates for NMF with β-Divergences under Disjoint Equality Constraints

by   Valentin Leplat, et al.

Nonnegative matrix factorization (NMF) is the problem of approximating an input nonnegative matrix, V, as the product of two smaller nonnegative matrices, W and H. In this paper, we introduce a general framework to design multiplicative updates (MU) for NMF based on β-divergences (β-NMF) with disjoint equality constraints, and with penalty terms in the objective function. By disjoint, we mean that each variable appears in at most one equality constraint. Our MU satisfy the set of constraints after each update of the variables during the optimization process, while guaranteeing that the objective function decreases monotonically. We showcase this framework on three NMF models, and show that it competes favorably the state of the art: (1) β-NMF with sum-to-one constraints on the columns of H, (2) minimum-volume β-NMF with sum-to-one constraints on the columns of W, and (3) sparse β-NMF with ℓ_2-norm constraints on the columns of W.



page 26

page 27

page 28

page 29


Distributionally Robust and Multi-Objective Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) is a linear dimensionality reduct...

Co-Separable Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) is a popular model in the field o...

Multiplicative Updates for Elastic Net Regularized Convolutional NMF Under β-Divergence

We generalize the convolutional NMF by taking the β-divergence as the lo...

Exact multiplicative updates for convolutional β-NMF in 2D

In this paper, we extend the β-CNMF to two dimensions and derive exact m...

Joint Majorization-Minimization for Nonnegative Matrix Factorization with the β-divergence

This article proposes new multiplicative updates for nonnegative matrix ...

The NMF problem and lattice-subspaces

Suppose that A is a nonnegative n× m real matrix. The NMF problem is the...

Bi-Objective Nonnegative Matrix Factorization: Linear Versus Kernel-Based Models

Nonnegative matrix factorization (NMF) is a powerful class of feature ex...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.