Multiplicative Updates for NMF with β-Divergences under Disjoint Equality Constraints

10/30/2020
by   Valentin Leplat, et al.
0

Nonnegative matrix factorization (NMF) is the problem of approximating an input nonnegative matrix, V, as the product of two smaller nonnegative matrices, W and H. In this paper, we introduce a general framework to design multiplicative updates (MU) for NMF based on β-divergences (β-NMF) with disjoint equality constraints, and with penalty terms in the objective function. By disjoint, we mean that each variable appears in at most one equality constraint. Our MU satisfy the set of constraints after each update of the variables during the optimization process, while guaranteeing that the objective function decreases monotonically. We showcase this framework on three NMF models, and show that it competes favorably the state of the art: (1) β-NMF with sum-to-one constraints on the columns of H, (2) minimum-volume β-NMF with sum-to-one constraints on the columns of W, and (3) sparse β-NMF with ℓ_2-norm constraints on the columns of W.

READ FULL TEXT

Authors

page 26

page 27

page 28

page 29

01/30/2019

Distributionally Robust and Multi-Objective Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) is a linear dimensionality reduct...
09/02/2021

Co-Separable Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) is a popular model in the field o...
03/14/2018

Multiplicative Updates for Elastic Net Regularized Convolutional NMF Under β-Divergence

We generalize the convolutional NMF by taking the β-divergence as the lo...
11/05/2018

Exact multiplicative updates for convolutional β-NMF in 2D

In this paper, we extend the β-CNMF to two dimensions and derive exact m...
06/29/2021

Joint Majorization-Minimization for Nonnegative Matrix Factorization with the β-divergence

This article proposes new multiplicative updates for nonnegative matrix ...
06/11/2019

The NMF problem and lattice-subspaces

Suppose that A is a nonnegative n× m real matrix. The NMF problem is the...
01/22/2015

Bi-Objective Nonnegative Matrix Factorization: Linear Versus Kernel-Based Models

Nonnegative matrix factorization (NMF) is a powerful class of feature ex...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.