Bayesian Mean-parameterized Nonnegative Binary Matrix Factorization

by   Alberto Lumbreras, et al.

Binary data matrices can represent many types of data such as social networks, votes or gene expression. In some cases, the analysis of binary matrices can be tackled with nonnegative matrix factorization (NMF), where the observed data matrix is approximated by the product of two smaller nonnegative matrices. In this context, probabilistic NMF assumes a generative model where the data is usually Bernoulli-distributed. Often, a link function is used to map the factorization to the [0,1] range, ensuring a valid Bernoulli mean parameter. However, link functions have the potential disadvantage to lead to uninterpretable models. Mean-parameterized NMF, on the contrary, overcomes this problem. We propose a unified framework for Bayesian mean-parameterized nonnegative binary matrix factorization models (NBMF). We analyze three models which correspond to three possible constraints that respect the mean-parametrization without the need for link functions. Furthermore, we derive a novel collapsed Gibbs sampler and a collapsed variational algorithm to infer the posterior distribution of the factors. Next, we extend the proposed models to a nonparametric setting where the number of used latent dimensions is automatically driven by the observed data. We analyze the performance of our NBMF methods in multiple datasets for different tasks such as dictionary learning and prediction of missing data. Experiments show that our methods provide similar or superior results than the state of the art, while automatically detecting the number of relevant components.


page 7

page 16

page 20

page 21

page 22


Flexible and Hierarchical Prior for Bayesian Nonnegative Matrix Factorization

In this paper, we introduce a probabilistic model for learning nonnegati...

Supervised Dictionary Learning by a Variational Bayesian Group Sparse Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) with group sparsity constraints i...

A majorization-minimization algorithm for nonnegative binary matrix factorization

This paper tackles the problem of decomposing binary data using matrix f...

Data embedding and prediction by sparse tropical matrix factorization

Matrix factorization methods are linear models, with limited capability ...

An Empirical Comparison of Sampling Quality Metrics: A Case Study for Bayesian Nonnegative Matrix Factorization

In this work, we empirically explore the question: how can we assess the...

Bayesian Group Nonnegative Matrix Factorization for EEG Analysis

We propose a generative model of a group EEG analysis, based on appropri...

Please sign up or login with your details

Forgot password? Click here to reset