SOBA: Session optimal MDP-based network friendly recommendations

12/07/2020
by   Theodoros Giannakas, et al.
0

Caching content over CDNs or at the network edge has been solidified as a means to improve network cost and offer better streaming experience to users. Furthermore, nudging the users towards low-cost content has recently gained momentum as a strategy to boost network performance. We focus on the problem of optimal policy design for Network Friendly Recommendations (NFR). We depart from recent modeling attempts, and propose a Markov Decision Process (MDP) formulation. MDPs offer a unified framework that can model a user with random session length. As it turns out, many state-of-the-art approaches can be cast as subcases of our MDP formulation. Moreover, the approach offers flexibility to model users who are reactive to the quality of the received recommendations. In terms of performance, for users consuming an arbitrary number of contents in sequence, we show theoretically and using extensive validation over real traces that the MDP approach outperforms myopic algorithms both in session cost as well as in offered recommendation quality. Finally, even compared to optimal state-of-art algorithms targeting specific subcases, our MDP framework is significantly more efficient, speeding the execution time by a factor of 10, and enjoying better scaling with the content catalog and recommendation batch sizes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/13/2019

The Order of Things: Position-Aware Network-friendly Recommendations in Long Viewing Sessions

Caching has recently attracted a lot of attention in the wireless commun...
research
10/02/2021

Network Friendly Recommendations: Optimizing for Long Viewing Sessions

Caching algorithms try to predict content popularity, and place the cont...
research
02/02/2019

When Collaborative Filtering Meets Reinforcement Learning

In this paper, we study a multi-step interactive recommendation problem,...
research
04/30/2021

Optimal control policies for resource allocation in the Cloud: comparison between Markov decision process and heuristic approaches

We consider an auto-scaling technique in a cloud system where virtual ma...
research
10/28/2019

Empirical Analysis of Session-Based Recommendation Algorithms

Recommender systems are tools that support online users by pointing them...
research
07/05/2016

One-Shot Session Recommendation Systems with Combinatorial Items

In recent years, content recommendation systems in large websites (or co...
research
11/15/2017

BoostJet: Towards Combining Statistical Aggregates with Neural Embeddings for Recommendations

Recommenders have become widely popular in recent years because of their...

Please sign up or login with your details

Forgot password? Click here to reset