Meta-Reinforcement Learning via Buffering Graph Signatures for Live Video Streaming Events

10/03/2021
by   Stefanos Antaris, et al.
0

In this study, we present a meta-learning model to adapt the predictions of the network's capacity between viewers who participate in a live video streaming event. We propose the MELANIE model, where an event is formulated as a Markov Decision Process, performing meta-learning on reinforcement learning tasks. By considering a new event as a task, we design an actor-critic learning scheme to compute the optimal policy on estimating the viewers' high-bandwidth connections. To ensure fast adaptation to new connections or changes among viewers during an event, we implement a prioritized replay memory buffer based on the Kullback-Leibler divergence of the reward/throughput of the viewers' connections. Moreover, we adopt a model-agnostic meta-learning framework to generate a global model from past events. As viewers scarcely participate in several events, the challenge resides on how to account for the low structural similarity of different events. To combat this issue, we design a graph signature buffer to calculate the structural similarities of several streaming events and adjust the training of the global model accordingly. We evaluate the proposed model on the link weight prediction task on three real-world datasets of live video streaming events. Our experiments demonstrate the effectiveness of our proposed model, with an average relative gain of 25 state-of-the-art strategies. For reproduction purposes, our evaluation datasets and implementation are publicly available at https://github.com/stefanosantaris/melanie

READ FULL TEXT
research
06/18/2021

Multi-Task Learning for User Engagement and Adoption in Live Video Streaming Events

Nowadays, live video streaming events have become a mainstay in viewer's...
research
07/28/2021

A Deep Graph Reinforcement Learning Model for Improving User Experience in Live Video Streaming

In this paper we present a deep graph reinforcement learning model to pr...
research
11/11/2020

EGAD: Evolving Graph Representation Learning with Self-Attention and Knowledge Distillation for Live Video Streaming Events

In this study, we present a dynamic graph representation learning model ...
research
11/11/2020

VStreamDRLS: Dynamic Graph Representation Learning with Self-Attention for Enterprise Distributed Video Streaming Solutions

Live video streaming has become a mainstay as a standard communication s...
research
05/20/2022

Swim: A Runtime for Distributed Event-Driven Applications

Swim extends the actor model to support applications composed of linked ...
research
08/24/2018

Towards Machine Learning-Based Optimal HAS

Mobile video consumption is increasing and sophisticated video quality a...

Please sign up or login with your details

Forgot password? Click here to reset