Unitary Approximate Message Passing for Matrix Factorization

07/31/2022
by   Zhengdao Yuan, et al.
10

We consider matrix factorization (MF) with certain constraints, which finds wide applications in various areas. Leveraging variational inference (VI) and unitary approximate message passing (UAMP), we develop a Bayesian approach to MF with an efficient message passing implementation, called UAMPMF. With proper priors imposed on the factor matrices, UAMPMF can be used to solve many problems that can be formulated as MF, such as non negative matrix factorization, dictionary learning, compressive sensing with matrix uncertainty, robust principal component analysis, and sparse matrix factorization. Extensive numerical examples are provided to show that UAMPMF significantly outperforms state-of-the-art algorithms in terms of recovery accuracy, robustness and computational complexity.

READ FULL TEXT

page 8

page 9

page 10

page 11

research
02/06/2014

Phase transitions and sample complexity in Bayes-optimal matrix factorization

We analyse the matrix factorization problem. Given a noisy measurement o...
research
09/28/2015

Boolean Matrix Factorization and Noisy Completion via Message Passing

Boolean matrix factorization and Boolean matrix completion from noisy ob...
research
04/03/2020

TRAMP: Compositional Inference with TRee Approximate Message Passing

We introduce tramp, standing for TRee Approximate Message Passing, a pyt...
research
03/05/2020

Straggler Robust Distributed Matrix Inverse Approximation

A cumbersome operation in numerical analysis and linear algebra, optimiz...
research
08/31/2021

Half-Space and Box Constraints as NUV Priors: First Results

Normals with unknown variance (NUV) can represent many useful priors and...
research
11/29/2021

Spherical Matrix Factorization

Matrix Factorization plays an important role in machine learning such as...
research
03/18/2021

Probabilistic Simplex Component Analysis

This study presents PRISM, a probabilistic simplex component analysis ap...

Please sign up or login with your details

Forgot password? Click here to reset