Evaluating Foveated Video Quality Using Entropic Differencing

06/12/2021
by   Yize Jin, et al.
0

Virtual Reality is regaining attention due to recent advancements in hardware technology. Immersive images / videos are becoming widely adopted to carry omnidirectional visual information. However, due to the requirements for higher spatial and temporal resolution of real video data, immersive videos require significantly larger bandwidth consumption. To reduce stresses on bandwidth, foveated video compression is regaining popularity, whereby the space-variant spatial resolution of the retina is exploited. Towards advancing the progress of foveated video compression, we propose a full reference (FR) foveated image quality assessment algorithm, which we call foveated entropic differencing (FED), which employs the natural scene statistics of bandpass responses by applying differences of local entropies weighted by a foveation-based error sensitivity function. We evaluate the proposed algorithm by measuring the correlations of the predictions that FED makes against human judgements on the newly created 2D and 3D LIVE-FBT-FCVR databases for Virtual Reality (VR). The performance of the proposed algorithm yields state-of-the-art as compared with other existing full reference algorithms. Software for FED has been made available at: http://live.ece.utexas.edu/research/Quality/FED.zip

READ FULL TEXT
research
06/24/2021

FOVQA: Blind Foveated Video Quality Assessment

Previous blind or No Reference (NR) video quality assessment (VQA) model...
research
05/21/2020

Omnidirectional Images as Moving Camera Videos

Omnidirectional images (also referred to as static 360 panoramas) impose...
research
04/21/2017

FISF: Better User Experience using Smaller Bandwidth for Panoramic Virtual Reality Video

The panoramic video is widely used to build virtual reality (VR) and is ...
research
11/07/2017

Viewport-aware adaptive 360° video streaming using tiles for virtual reality

360 video is attracting an increasing amount of attention in the context...
research
06/01/2016

A Comparative Study of Algorithms for Realtime Panoramic Video Blending

Unlike image blending algorithms, video blending algorithms have been li...
research
06/19/2020

Capturing Video Frame Rate Variations via Entropic Differencing

High frame rate videos are increasingly getting popular in recent years,...
research
04/19/2020

The Hyper360 toolset for enriched 360^∘ video

360^∘ video is a novel media format, rapidly becoming adopted in media p...

Please sign up or login with your details

Forgot password? Click here to reset