BanditMF: Multi-Armed Bandit Based Matrix Factorization Recommender System

06/21/2021
by   Shenghao Xu, et al.
0

Multi-armed bandits (MAB) provide a principled online learning approach to attain the balance between exploration and exploitation. Due to the superior performance and low feedback learning without the learning to act in multiple situations, Multi-armed Bandits drawing widespread attention in applications ranging such as recommender systems. Likewise, within the recommender system, collaborative filtering (CF) is arguably the earliest and most influential method in the recommender system. Crucially, new users and an ever-changing pool of recommended items are the challenges that recommender systems need to address. For collaborative filtering, the classical method is training the model offline, then perform the online testing, but this approach can no longer handle the dynamic changes in user preferences which is the so-called cold start. So how to effectively recommend items to users in the absence of effective information? To address the aforementioned problems, a multi-armed bandit based collaborative filtering recommender system has been proposed, named BanditMF. BanditMF is designed to address two challenges in the multi-armed bandits algorithm and collaborative filtering: (1) how to solve the cold start problem for collaborative filtering under the condition of scarcity of valid information, (2) how to solve the sub-optimal problem of bandit algorithms in strong social relations domains caused by independently estimating unknown parameters associated with each user and ignoring correlations between users.

READ FULL TEXT

page 24

page 25

page 36

page 37

research
02/11/2015

Collaborative Filtering Bandits

Classical collaborative filtering, and content-based filtering methods t...
research
09/16/2020

Partial Bandit and Semi-Bandit: Making the Most Out of Scarce Users' Feedback

Recent works on Multi-Armed Bandits (MAB) and Combinatorial Multi-Armed ...
research
09/04/2023

Interactive Graph Convolutional Filtering

Interactive Recommender Systems (IRS) have been increasingly used in var...
research
05/14/2023

Multi-View Interactive Collaborative Filtering

In many scenarios, recommender system user interaction data such as clic...
research
03/25/2019

Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systems

Social recommendation leverages social information to solve data sparsit...
research
09/06/2022

A Scalable Recommendation Engine for New Users and Items

In many digital contexts such as online news and e-tailing with many new...
research
08/16/2019

Accelerated learning from recommender systems using multi-armed bandit

Recommendation systems are a vital component of many online marketplaces...

Please sign up or login with your details

Forgot password? Click here to reset