Automatic Hyperparameter Tuning in Sparse Matrix Factorization

05/17/2023
by   Ryota Kawasumi, et al.
0

We study the problem of hyperparameter tuning in sparse matrix factorization under Bayesian framework. In the prior work, an analytical solution of sparse matrix factorization with Laplace prior was obtained by variational Bayes method under several approximations. Based on this solution, we propose a novel numerical method of hyperparameter tuning by evaluating the zero point of normalization factor in sparse matrix prior. We also verify that our method shows excellent performance for ground-truth sparse matrix reconstruction by comparing it with the widely-used algorithm of sparse principal component analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2018

Approximate Method of Variational Bayesian Matrix Factorization/Completion with Sparse Prior

We derive analytical expression of matrix factorization/completion solut...
research
06/28/2019

Cross-product Penalized Component Analysis (XCAN)

Matrix factorization methods are extensively employed to understand comp...
research
10/27/2019

Prior specification via prior predictive matching: Poisson matrix factorization and beyond

Hyperparameter optimization for machine learning models is typically car...
research
02/20/2018

Empirical Bayes Matrix Factorization

Matrix factorization methods - including Factor analysis (FA), and Princ...
research
05/17/2020

Bayesian biclustering for microbial metagenomic sequencing data via multinomial matrix factorization

High-throughput sequencing technology provides unprecedented opportuniti...
research
11/29/2021

Spherical Matrix Factorization

Matrix Factorization plays an important role in machine learning such as...
research
12/13/2013

Sample Complexity of Dictionary Learning and other Matrix Factorizations

Many modern tools in machine learning and signal processing, such as spa...

Please sign up or login with your details

Forgot password? Click here to reset