Reinforcement learning based recommender systems: A survey

01/15/2021
by   M. Mehdi Afsar, et al.
0

Recommender systems (RSs) are becoming an inseparable part of our everyday lives. They help us find our favorite items to purchase, our friends on social networks, and our favorite movies to watch. Traditionally, the recommendation problem was considered as a simple classification or prediction problem; however, the sequential nature of the recommendation problem has been shown. Accordingly, it can be formulated as a Markov decision process (MDP) and reinforcement learning (RL) methods can be employed to solve it. In fact, recent advances in combining deep learning with traditional RL methods, i.e. deep reinforcement learning (DRL), has made it possible to apply RL to the recommendation problem with massive state and action spaces. In this paper, a survey on reinforcement learning based recommender systems (RLRSs) is presented. We first recognize the fact that algorithms developed for RLRSs can be generally classified into RL- and DRL-based methods. Then, we present these RL- and DRL-based methods in a classified manner based on the specific RL algorithm, e.g., Q-learning, SARSA, and REINFORCE, that is used to optimize the recommendation policy. Furthermore, some tables are presented that contain detailed information about the MDP formulation of these methods, as well as about their evaluation schemes. Finally, we discuss important aspects and challenges that can be addressed in the future.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/22/2021

A Survey on Reinforcement Learning for Recommender Systems

Recommender systems have been widely applied in different real-life scen...
research
01/17/2018

Reinforcement Learning based Recommender System using Biclustering Technique

A recommender system aims to recommend items that a user is interested i...
research
07/23/2018

Learning to Play Pong using Policy Gradient Learning

Activities in reinforcement learning (RL) revolve around learning the Ma...
research
06/22/2021

Reinforcement Learning for Physical Layer Communications

In this chapter, we will give comprehensive examples of applying RL in o...
research
02/23/2017

Automatic Representation for Lifetime Value Recommender Systems

Many modern commercial sites employ recommender systems to propose relev...
research
12/14/2020

A Reinforcement Learning Formulation of the Lyapunov Optimization: Application to Edge Computing Systems with Queue Stability

In this paper, a deep reinforcement learning (DRL)-based approach to the...
research
12/12/2012

An MDP-based Recommender System

Typical Recommender systems adopt a static view of the recommendation pr...

Please sign up or login with your details

Forgot password? Click here to reset