Theoretically Accurate Regularization Technique for Matrix Factorization based Recommender Systems

05/21/2022
by   Hao Wang, et al.
47

Regularization is a popular technique to solve the overfitting problem of machine learning algorithms. Most regularization technique relies on parameter selection of the regularization coefficient. Plug-in method and cross-validation approach are two most common parameter selection approaches for regression methods such as Ridge Regression, Lasso Regression and Kernel Regression. Matrix factorization based recommendation system also has heavy reliance on the regularization technique. Most people select a single scalar value to regularize the user feature vector and item feature vector independently or collectively. In this paper, we prove that such approach of selecting regularization coefficient is invalid, and we provide a theoretically accurate method that outperforms the most widely used approach in both accuracy and fairness metrics.

READ FULL TEXT
12/06/2021

MatMat: Matrix Factorization by Matrix Fitting

Matrix factorization is a widely adopted recommender system technique th...
04/27/2022

KL-Mat : Fair Recommender System via Information Geometry

Recommender system has intrinsic problems such as sparsity and fairness....
10/04/2021

Optimal hybrid parameter selection for stable sequential solution of inverse heat conduction problem

To deal with the ill-posed nature of the inverse heat conduction problem...
05/28/2019

LambdaOpt: Learn to Regularize Recommender Models in Finer Levels

Recommendation models mainly deal with categorical variables, such as us...
05/27/2021

Towards a Better Understanding of Linear Models for Recommendation

Recently, linear regression models, such as EASE and SLIM, have shown to...
11/06/2017

Independently Interpretable Lasso: A New Regularizer for Sparse Regression with Uncorrelated Variables

Sparse regularization such as ℓ_1 regularization is a quite powerful and...
08/04/2020

No Cross-Validation Required: An Analytical Framework for Regularized Mixed-Integer Problems (Extended Version)

This paper develops a method to obtain the optimal value for the regular...