Prediction of the Influence of Navigation Scan-path on Perceived Quality of Free-Viewpoint Videos

10/10/2018
by   Suiyi Ling, et al.
0

Free-Viewpoint Video (FVV) systems allow the viewers to freely change the viewpoints of the scene. In such systems, view synthesis and compression are the two main sources of artifacts influencing the perceived quality. To assess this influence, quality evaluation studies are often carried out using conventional displays and generating predefined navigation trajectories mimicking the possible movement of the viewers when exploring the content. Nevertheless, as different trajectories may lead to different conclusions in terms of visual quality when benchmarking the performance of the systems, methods to identify critical trajectories are needed. This paper aims at exploring the impact of exploration trajectories (defined as Hypothetical Rendering Trajectories: HRT) on perceived quality of FVV subjectively and objectively, providing two main contributions. Firstly, a subjective assessment test including different HRTs was carried out and analyzed. The results demonstrate and quantify the influence of HRT in the perceived quality. Secondly, we propose a new objective video quality assessment measure to objectively predict the impact of HRT. This measure, based on Sketch-Token representation, models how the categories of the contours change spatially and temporally from a higher semantic level. Performance in comparison with existing quality metrics for FVV, highlight promising results for automatic detection of most critical HRTs for the benchmark of immersive systems.

READ FULL TEXT

page 6

page 8

research
02/22/2022

Banding vs. Quality: Perceptual Impact and Objective Assessment

Staircase-like contours introduced to a video by quantization in flat ar...
research
03/24/2023

Perceptual Quality Assessment of NeRF and Neural View Synthesis Methods for Front-Facing Views

Neural view synthesis (NVS) is one of the most successful techniques for...
research
11/11/2019

Pano: Optimizing 360° Video Streaming with a Better Understanding of Quality Perception

Streaming 360 videos requires more bandwidth than non-360 videos. This i...
research
07/08/2022

Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessment

With the rapid growth of in-the-wild videos taken by non-specialists, bl...
research
03/28/2019

Quality Assessment of Free-viewpoint Videos by Quantifying the Elastic Changes of Multi-Scale Motion Trajectories

Virtual viewpoints synthesis is an essential process for many immersive ...
research
08/29/2018

Binocular Rivalry - Psychovisual Challenge in Stereoscopic Video Error Concealment

During Stereoscopic 3D (S3D) video transmission, one or both views can b...
research
11/16/2019

Quality Assessment of DIBR-synthesized views: An Overview

The Depth-Image-Based-Rendering (DIBR) is one of the main fundamental te...

Please sign up or login with your details

Forgot password? Click here to reset