DeepAI
Log In Sign Up

Real-world Video Adaptation with Reinforcement Learning

08/28/2020
by   Hongzi Mao, et al.
8

Client-side video players employ adaptive bitrate (ABR) algorithms to optimize user quality of experience (QoE). We evaluate recently proposed RL-based ABR methods in Facebook's web-based video streaming platform. Real-world ABR contains several challenges that requires customized designs beyond off-the-shelf RL algorithms – we implement a scalable neural network architecture that supports videos with arbitrary bitrate encodings; we design a training method to cope with the variance resulting from the stochasticity in network conditions; and we leverage constrained Bayesian optimization for reward shaping in order to optimize the conflicting QoE objectives. In a week-long worldwide deployment with more than 30 million video streaming sessions, our RL approach outperforms the existing human-engineered ABR algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/15/2022

FRAS: Federated Reinforcement Learning empowered Adaptive Point Cloud Video Streaming

Point cloud video transmission is challenging due to high encoding/decod...
09/29/2020

Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network

In the tile-based 360-degree video streaming, predicting user's future v...
01/13/2023

From Ember to Blaze: Swift Interactive Video Adaptation via Meta-Reinforcement Learning

Maximizing quality of experience (QoE) for interactive video streaming h...
07/15/2021

NeuSaver: Neural Adaptive Power Consumption Optimization for Mobile Video Streaming

Video streaming services strive to support high-quality videos at higher...
05/21/2018

Multi-User Cooperative Mobile Video Streaming: Performance Analysis and Online Mechanism Design

Adaptive bitrate streaming enables video users to adapt their playing bi...
08/06/2020

Internet-Scale Video Streaming over NDN

Research in Information-Centric Networking (ICN) and Named Data Networki...
11/15/2018

Tiyuntsong: A Self-Play Reinforcement Learning Approach for ABR Video Streaming

Existing reinforcement learning(RL)-based adaptive bitrate(ABR) approach...