DeepAI AI Chat
Log In Sign Up

Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding

by   Andy Regensky, et al.

Inter prediction is one of the key technologies enabling the high compression efficiency of modern video coding standards. 360-degree video needs to be mapped to the 2D image plane prior to coding in order to allow compression using existing video coding standards. The distortions that inevitably occur when mapping spherical data onto the 2D image plane, however, impair the performance of classical inter prediction techniques. In this paper, we propose a motion-plane-adaptive inter prediction technique (MPA) for 360-degree video that takes the spherical characteristics of 360-degree video into account. Based on the known projection format of the video, MPA allows to perform inter prediction on different motion planes in 3D space instead of having to work on the - in theory arbitrarily mapped - 2D image representation directly. We furthermore derive a motion-plane-adaptive motion vector prediction technique (MPA-MVP) that allows to translate motion information between different motion planes and motion models. Our proposed integration of MPA together with MPA-MVP into the state-of-the-art H.266/VVC video coding standard shows significant Bjontegaard Delta rate savings of 1.72 1.56 on average.


page 1

page 5

page 7

page 11


Robust Video Watermarking against H.264 and H.265 Compression Attacks

This paper proposes a robust watermarking method for uncompressed video ...

Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding

Plenoptic images and videos bearing rich information demand a tremendous...

A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video

Although fisheye cameras are in high demand in many application areas du...

Memory Assessment of Versatile Video Coding

This paper presents a memory assessment of the next-generation Versatile...

End-to-end Neural Video Coding Using a Compound Spatiotemporal Representation

Recent years have witnessed rapid advances in learnt video coding. Most ...

HEVC Inter Coding Using Deep Recurrent Neural Networks and Artificial Reference Pictures

The efficiency of motion compensated prediction in modern video codecs h...

Co-projection-plane based 3-D padding for polyhedron projection for 360-degree video

The polyhedron projection for 360-degree video is becoming more and more...