Probabilistic Tile Visibility-Based Server-Side Rate Adaptation for Adaptive 360-Degree Video Streaming

06/20/2019
by   Junni Zou, et al.
0

In this paper, we study the server-side rate adaptation problem for streaming tile-based adaptive 360-degree videos to multiple users who are competing for transmission resources at the network bottleneck. Specifically, we develop a convolutional neural network (CNN)-based viewpoint prediction model to capture the nonlinear relationship between the future and historical viewpoints. A Laplace distribution model is utilized to characterize the probability distribution of the prediction error. Given the predicted viewpoint, we then map the viewport in the spherical space into its corresponding planar projection in the 2-D plane, and further derive the visibility probability of each tile based on the planar projection and the prediction error probability. According to the visibility probability, tiles are classified as viewport, marginal and invisible tiles. The server-side tile rate allocation problem for multiple users is then formulated as a non-linear discrete optimization problem to minimize the overall received video distortion of all users and the quality difference between the viewport and marginal tiles of each user, subject to the transmission capacity constraints and users' specific viewport requirements. We develop a steepest descent algorithm to solve this non-linear discrete optimization problem, by initializing the feasible starting point in accordance with the optimal solution of its continuous relaxation. Extensive experimental results show that the proposed algorithm can achieve a near-optimal solution, and outperforms the existing rate adaptation schemes for tile-based adaptive 360-video streaming.

READ FULL TEXT

page 9

page 10

page 18

page 25

research
01/10/2020

QoE-driven Coupled Uplink and Downlink Rate Adaptation for 360-degree Video Live Streaming

360-degree video provides an immersive 360-degree viewing experience and...
research
04/13/2021

Optimal Transmission of Multi-Quality Tiled 360 VR Video in MIMO-OFDMA Systems

In this paper, we study the optimal transmission of a multi-quality tile...
research
09/27/2018

Optimal Multicast of Tiled 360 VR Video in OFDMA Systems

In this letter, we study optimal multicast of tiled 360 virtual reality ...
research
09/29/2020

Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network

In the tile-based 360-degree video streaming, predicting user's future v...
research
07/20/2021

Adaptive Streaming of 360 Videos with Perfect, Imperfect, and Unknown FoV Viewing Probabilities in Wireless Networks

This paper investigates adaptive streaming of one or multiple tiled 360 ...
research
07/29/2023

VATP360: Viewport Adaptive 360-Degree Video Streaming based on Tile Priority

360-degree video becomes increasingly popular among users. In the curren...
research
02/25/2018

Adaptive Streaming in Interactive Multiview Video Systems

Multiview applications endow final users with the possibility to freely ...

Please sign up or login with your details

Forgot password? Click here to reset