On the Effectiveness of Low-rank Approximations for Collaborative Filtering compared to Neural Networks

05/30/2019
by   Marcel Kurovski, et al.
0

Even in times of deep learning, low-rank approximations by factorizing a matrix into user and item latent factors continue to be a method of choice for collaborative filtering tasks due to their great performance. While deep learning based approaches excel in hybrid recommender tasks where additional features for items, users or even context are available, their flexibility seems to rather impair the performance compared to low-rank approximations for pure collaborative filtering tasks where no additional features are used. Recent works propose hybrid models combining low-rank approximations and traditional deep neural architectures with promising results but fail to explain why neural networks alone are unsuitable for this task. In this work, we revisit the model and intuition behind low-rank approximation to point out its suitability for collaborative filtering tasks. In several experiments we compare the performance and behavior of models based on a deep neural network and low-rank approximation to examine the reasons for the low effectiveness of traditional deep neural networks. We conclude that the universal approximation capabilities of traditional deep neural networks severely impair the determination of suitable latent vectors, leading to a worse performance compared to low-rank approximations.

READ FULL TEXT

page 3

page 4

research
06/09/2014

A Hybrid Latent Variable Neural Network Model for Item Recommendation

Collaborative filtering is used to recommend items to a user without req...
research
12/26/2018

Deep Item-based Collaborative Filtering for Sparse Implicit Feedback

Recommender systems are ubiquitous in the domain of e-commerce, used to ...
research
02/17/2016

Choice by Elimination via Deep Neural Networks

We introduce Neural Choice by Elimination, a new framework that integrat...
research
11/15/2021

Evolving Deep Neural Networks for Collaborative Filtering

Collaborative Filtering (CF) is widely used in recommender systems to mo...
research
09/27/2022

Exploring Low Rank Training of Deep Neural Networks

Training deep neural networks in low rank, i.e. with factorised layers, ...
research
06/10/2019

Towards Amortized Ranking-Critical Training for Collaborative Filtering

Collaborative filtering is widely used in modern recommender systems. Re...
research
01/18/2015

Deep Belief Nets for Topic Modeling

Applying traditional collaborative filtering to digital publishing is ch...

Please sign up or login with your details

Forgot password? Click here to reset