Perceptual Evaluation of 360 Audiovisual Quality and Machine Learning Predictions

12/22/2021
by   Randy Frans Fela, et al.
0

In an earlier study, we gathered perceptual evaluations of the audio, video, and audiovisual quality for 360 audiovisual content. This paper investigates perceived audiovisual quality prediction based on objective quality metrics and subjective scores of 360 video and spatial audio content. Thirteen objective video quality metrics and three objective audio quality metrics were evaluated for five stimuli for each coding parameter. Four regression-based machine learning models were trained and tested here, i.e., multiple linear regression, decision tree, random forest, and support vector machine. Each model was constructed using a combination of audio and video quality metrics and two cross-validation methods (k-Fold and Leave-One-Out) were investigated and produced 312 predictive models. The results indicate that the model based on the evaluation of VMAF and AMBIQUAL is better than other combinations of audio-video quality metric. In this study, support vector machine provides higher performance using k-Fold (PCC = 0.909, SROCC = 0.914, and RMSE = 0.416). These results can provide insights for the design of multimedia quality metrics and the development of predictive models for audiovisual omnidirectional media.

READ FULL TEXT

page 1

page 4

research
05/16/2022

Perceptual Evaluation on Audio-visual Dataset of 360 Content

To open up new possibilities to assess the multimodal perceptual quality...
research
05/19/2020

Towards a Perceived Audiovisual Quality Model for Immersive Content

This paper studies the quality of multimedia content focusing on 360 vid...
research
08/31/2022

Evaluating generative audio systems and their metrics

Recent years have seen considerable advances in audio synthesis with dee...
research
01/30/2020

NAViDAd: A No-Reference Audio-Visual Quality Metric Based on a Deep Autoencoder

The development of models for quality prediction of both audio and video...
research
07/10/2018

The Helmholtz Method: Using Perceptual Compression to Reduce Machine Learning Complexity

This paper proposes a fundamental answer to a frequently asked question ...
research
09/21/2020

Subjective Metrics-based Cloud Market Performance Prediction

This paper explores an effective machine learning approach to predict cl...
research
04/25/2023

Performance Evaluation of Regression Models in Predicting the Cost of Medical Insurance

The study aimed to evaluate the regression models' performance in predic...

Please sign up or login with your details

Forgot password? Click here to reset