Empirical Bayes Matrix Factorization

02/20/2018
by   Wei Wang, et al.
0

Matrix factorization methods - including Factor analysis (FA), and Principal Components Analysis (PCA) - are widely used for inferring and summarizing structure in multivariate data. Many matrix factorization methods exist, corresponding to different assumptions on the elements of the underlying matrix factors. For example, many recent methods use a penalty or prior distribution to achieve sparse representations ("Sparse FA/PCA"). Here we introduce a general Empirical Bayes approach to matrix factorization (EBMF), whose key feature is that it uses the observed data to estimate prior distributions on matrix elements. We derive a correspondingly-general variational fitting algorithm, which reduces fitting EBMF to solving a simpler problem - the so-called "normal means" problem. We implement this general algorithm, but focus particular attention on the use of sparsity-inducing priors that are uni-modal at 0. This yields a sparse EBMF approach - essentially a version of sparse FA/PCA - that automatically adapts the amount of sparsity to the data. We demonstrate the benefits of our approach through both numerical comparisons with competing methods and through analysis of data from the GTEx (Genotype Tissue Expression) project on genetic associations across 44 human tissues. In numerical comparisons EBMF often provides more accurate inferences than other methods. In the GTEx data, EBMF identifies interpretable structure that concords with known relationships among human tissues. Software implementing our approach is available at https://github.com/stephenslab/flashr.

READ FULL TEXT
research
03/14/2018

Approximate Method of Variational Bayesian Matrix Factorization/Completion with Sparse Prior

We derive analytical expression of matrix factorization/completion solut...
research
03/05/2023

MFAI: A Scalable Bayesian Matrix Factorization Approach to Leveraging Auxiliary Information

In various practical situations, matrix factorization methods suffer fro...
research
10/01/2021

ebnm: An R Package for Solving the Empirical Bayes Normal Means Problem Using a Variety of Prior Families

The empirical Bayes normal means (EBNM) model plays an important role in...
research
06/27/2012

Matrix Tile Analysis

Many tasks require finding groups of elements in a matrix of numbers, sy...
research
05/17/2023

Automatic Hyperparameter Tuning in Sparse Matrix Factorization

We study the problem of hyperparameter tuning in sparse matrix factoriza...
research
12/13/2022

Accelerated structured matrix factorization

Matrix factorization exploits the idea that, in complex high-dimensional...
research
04/01/2022

Deep Neural Convolutive Matrix Factorization for Articulatory Representation Decomposition

Most of the research on data-driven speech representation learning has f...

Please sign up or login with your details

Forgot password? Click here to reset