Theoretically Accurate Regularization Technique for Matrix Factorization based Recommender Systems

05/21/2022
by   Hao Wang, et al.
47

Regularization is a popular technique to solve the overfitting problem of machine learning algorithms. Most regularization technique relies on parameter selection of the regularization coefficient. Plug-in method and cross-validation approach are two most common parameter selection approaches for regression methods such as Ridge Regression, Lasso Regression and Kernel Regression. Matrix factorization based recommendation system also has heavy reliance on the regularization technique. Most people select a single scalar value to regularize the user feature vector and item feature vector independently or collectively. In this paper, we prove that such approach of selecting regularization coefficient is invalid, and we provide a theoretically accurate method that outperforms the most widely used approach in both accuracy and fairness metrics.

READ FULL TEXT
research
12/06/2021

MatMat: Matrix Factorization by Matrix Fitting

Matrix factorization is a widely adopted recommender system technique th...
research
04/27/2022

KL-Mat : Fair Recommender System via Information Geometry

Recommender system has intrinsic problems such as sparsity and fairness....
research
10/04/2021

Optimal hybrid parameter selection for stable sequential solution of inverse heat conduction problem

To deal with the ill-posed nature of the inverse heat conduction problem...
research
05/28/2019

LambdaOpt: Learn to Regularize Recommender Models in Finer Levels

Recommendation models mainly deal with categorical variables, such as us...
research
05/27/2021

Towards a Better Understanding of Linear Models for Recommendation

Recently, linear regression models, such as EASE and SLIM, have shown to...
research
08/25/2015

OCReP: An Optimally Conditioned Regularization for Pseudoinversion Based Neural Training

In this paper we consider the training of single hidden layer neural net...
research
11/06/2017

Independently Interpretable Lasso: A New Regularizer for Sparse Regression with Uncorrelated Variables

Sparse regularization such as ℓ_1 regularization is a quite powerful and...

Please sign up or login with your details

Forgot password? Click here to reset