DeepAI AI Chat
Log In Sign Up

Quantitative analysis of Matthew effect and sparsity problem of recommender systems

by   Hao Wang, et al.

Recommender systems have received great commercial success. Recommendation has been used widely in areas such as e-commerce, online music FM, online news portal, etc. However, several problems related to input data structure pose serious challenge to recommender system performance. Two of these problems are Matthew effect and sparsity problem. Matthew effect heavily skews recommender system output towards popular items. Data sparsity problem directly affects the coverage of recommendation result. Collaborative filtering is a simple benchmark ubiquitously adopted in the industry as the baseline for recommender system design. Understanding the underlying mechanism of collaborative filtering is crucial for further optimization. In this paper, we do a thorough quantitative analysis on Matthew effect and sparsity problem in the particular context setting of collaborative filtering. We compare the underlying mechanism of user-based and item-based collaborative filtering and give insight to industrial recommender system builders.


page 4

page 5


Movie Recommender Systems: Implementation and Performance Evaluation

Over the years, explosive growth in the number of items in the catalog o...

Deep Heterogeneous Autoencoders for Collaborative Filtering

This paper leverages heterogeneous auxiliary information to address the ...

Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insights

Text-based collaborative filtering (TCF) has become the mainstream appro...

Sparsity Normalization: Stabilizing the Expected Outputs of Deep Networks

The learning of deep models, in which a numerous of parameters are super...

A Collaborative Filtering Recommender System for Test Case Prioritization in Web Applications

The use of relevant metrics of software systems could improve various so...

Local Optimality of User Choices and Collaborative Competitive Filtering

While a user's preference is directly reflected in the interactive choic...

A recommender system to restore images with impulse noise

We build a collaborative filtering recommender system to restore images ...