Perceptual Evaluation on Audio-visual Dataset of 360 Content

05/16/2022
by   Randy F Fela, et al.
0

To open up new possibilities to assess the multimodal perceptual quality of omnidirectional media formats, we proposed a novel open source 360 audiovisual (AV) quality dataset. The dataset consists of high-quality 360 video clips in equirectangular (ERP) format and higher-order ambisonic (4th order) along with the subjective scores. Three subjective quality experiments were conducted for audio, video, and AV with the procedures detailed in this paper. Using the data from subjective tests, we demonstrated that this dataset can be used to quantify perceived audio, video, and audiovisual quality. The diversity and discriminability of subjective scores were also analyzed. Finally, we investigated how our dataset correlates with various objective quality metrics of audio and video. Evidence from the results of this study implies that the proposed dataset can benefit future studies on multimodal quality evaluation of 360 content.

READ FULL TEXT

page 1

page 2

research
12/22/2021

Perceptual Evaluation of 360 Audiovisual Quality and Machine Learning Predictions

In an earlier study, we gathered perceptual evaluations of the audio, vi...
research
05/19/2020

Towards a Perceived Audiovisual Quality Model for Immersive Content

This paper studies the quality of multimedia content focusing on 360 vid...
research
12/03/2022

A subjective study of the perceptual acceptability of audio-video desynchronization in sports videos

This paper presents the results of a study conducted on the perceptual a...
research
03/13/2018

3D Video Quality Assessment

A key factor in designing 3D systems is to understand how different visu...
research
03/08/2022

Reproducible Subjective Evaluation

Human perceptual studies are the gold standard for the evaluation of man...
research
04/01/2020

Improving Perceptual Quality of Drum Transcription with the Expanded Groove MIDI Dataset

Classifier metrics, such as accuracy and F-measure score, often serve as...
research
03/18/2022

Towards a Perceptual Model for Estimating the Quality of Visual Speech

Generating realistic lip motions to simulate speech production is key fo...

Please sign up or login with your details

Forgot password? Click here to reset