HTML5 MSE Playback of MPEG 360 VR Tiled Streaming
share
Virtual Reality (VR) and 360-degree video streaming have gained significant attention in recent years. First standards have been published in order to avoid market fragmentation. For instance, 3GPP released its first specification on VR to enable 360-degree video streaming over 5G networks while relying on several technologies specified in ISO/IEC 23090-2, also known as MPEG-OMAF. While some implementations of OMAF-compatible players have already been demonstrated at several trade shows, we have not yet seen any implementations of viewport-dependent media profile in a web browser. In this demo paper we describe how we implemented the most advanced media profile from OMAF: HEVC-based viewport-dependent OMAF video profile with multi-resolution HEVC-tiles, using only JavaScript. We also describe how to overcome certain missing features that HTML5 browsers do not provide today to fully support OMAF. The implementation was tested on Safari browser with support of HEVC video through HTML5 Media Source Extensions API. In addition, the WebGL API is used for rendering, using region-wise packing metadata defined in OMAF.
READ FULL TEXT