Efficient Model-Based Collaborative Filtering with Fast Adaptive PCA

09/04/2020
by   Xiangyun Ding, et al.
0

A model-based collaborative filtering (CF) approach utilizing fast adaptive randomized singular value decomposition (SVD) is proposed for the matrix completion problem in recommender system. Firstly, a fast adaptive PCA frameworkis presented which combines the fixed-precision randomized matrix factorization algorithm [1] and accelerating skills for handling large sparse data. Then, a novel termination mechanism for the adaptive PCA is proposed to automatically determine a number of latent factors for achieving the near optimal prediction accuracy during the subsequent model-based CF. The resulted CF approach has good accuracy while inheriting high runtime efficiency. Experiments on real data show that, the proposed adaptive PCA is up to 2.7X and 6.7X faster than the original fixed-precision SVD approach [1] and svds in Matlab repsectively, while preserving accuracy. The proposed model-based CF approach is able to efficiently process the MovieLens data with 20M ratings and exhibits more than 10X speedup over the regularized matrix factorization based approach [2] and the fast singular value thresholding approach [3] with comparable or better accuracy. It also owns the advantage of parameter free. Compared with the deep-learning-based CF approach, the proposed approach is much more computationally efficient, with just marginal performance loss.

READ FULL TEXT
research
10/16/2018

Faster Matrix Completion Using Randomized SVD

Matrix completion is a widely used technique for image inpainting and pe...
research
11/26/2019

Shifted Randomized Singular Value Decomposition

We extend the randomized singular value decomposition (SVD) algorithm <c...
research
10/25/2021

NetMF+: Network Embedding Based on Fast and Effective Single-Pass Randomized Matrix Factorization

In this work, we propose NetMF+, a fast, memory-efficient, scalable, and...
research
12/13/2020

A Refined SVD Algorithm for Collaborative Filtering

Collaborative filtering tries to predict the ratings of a user over some...
research
10/16/2018

Fast Randomized PCA for Sparse Data

Principal component analysis (PCA) is widely used for dimension reductio...
research
12/02/2019

A Fast Matrix-Completion-Based Approach for Recommendation Systems

Matrix completion is widely used in machine learning, engineering contro...
research
03/30/2023

Matrix diagonalization and singular value decomposition: Static SageMath and dynamic ChatGPT juxtaposed

We investigated some difficulties that students often face when studying...

Please sign up or login with your details

Forgot password? Click here to reset