Sparse encoding for more-interpretable feature-selecting representations in probabilistic matrix factorization

12/08/2020
by   Joshua C. Chang, et al.
0

Dimensionality reduction methods for count data are critical to a wide range of applications in medical informatics and other fields where model interpretability is paramount. For such data, hierarchical Poisson matrix factorization (HPF) and other sparse probabilistic non-negative matrix factorization (NMF) methods are considered to be interpretable generative models. They consist of sparse transformations for decoding their learned representations into predictions. However, sparsity in representation decoding does not necessarily imply sparsity in the encoding of representations from the original data features. HPF is often incorrectly interpreted in the literature as if it possesses encoder sparsity. The distinction between decoder sparsity and encoder sparsity is subtle but important. Due to the lack of encoder sparsity, HPF does not possess the column-clustering property of classical NMF – the factor loading matrix does not sufficiently define how each factor is formed from the original features. We address this deficiency by self-consistently enforcing encoder sparsity, using a generalized additive model (GAM), thereby allowing one to relate each representation coordinate to a subset of the original data features. In doing so, the method also gains the ability to perform feature selection. We demonstrate our method on simulated data and give an example of how encoder sparsity is of practical use in a concrete application of representing inpatient comorbidities in Medicare patients.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 10

page 11

page 12

page 14

research
04/27/2021

Structured Sparse Non-negative Matrix Factorization with L20-Norm for scRNA-seq Data Analysis

Non-negative matrix factorization (NMF) is a powerful tool for dimension...
research
10/31/2019

Solving NMF with smoothness and sparsity constraints using PALM

Non-negative matrix factorization is a problem of dimensionality reducti...
research
02/05/2019

Minimum description length as an objective function for non-negative matrix factorization

Non-negative matrix factorization (NMF) is a dimensionality reduction te...
research
11/02/2022

Rank Selection for Non-negative Matrix Factorization

Non-Negative Matrix Factorization (NMF) is a widely used dimension reduc...
research
12/06/2017

Exchangeable modelling of relational data: checking sparsity, train-test splitting, and sparse exchangeable Poisson matrix factorization

A variety of machine learning tasks---e.g., matrix factorization, topic ...
research
12/09/2019

Grouped sparse projection

As evident from deep learning, very large models bring improvements in t...
research
12/05/2019

Probabilistically-autoencoded horseshoe-disentangled multidomain item-response theory models

Item response theory (IRT) is a non-linear generative probabilistic para...

Please sign up or login with your details

Forgot password? Click here to reset