AudioVMAF: Audio Quality Prediction with VMAF

08/07/2023
by   Arijit Biswas, et al.
0

Video Multimethod Assessment Fusion (VMAF) [1], [2], [3] is a popular tool in the industry for measuring coded video quality. In this study, we propose an auditory-inspired frontend in existing VMAF for creating videos of reference and coded spectrograms, and extended VMAF for measuring coded audio quality. We name our system AudioVMAF. We demonstrate that image replication is capable of further enhancing prediction accuracy, especially when band-limited anchors are present. The proposed method significantly outperforms all existing visual quality features repurposed for audio, and even demonstrates a significant overall improvement of 7.8 coefficient, respectively, over a dedicated audio quality metric (ViSQOL-v3 [4]) also inspired from the image domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/20/2023

Perceptual Quality Assessment of Omnidirectional Audio-visual Signals

Omnidirectional videos (ODVs) play an increasingly important role in the...
research
09/15/2023

AV-MaskEnhancer: Enhancing Video Representations through Audio-Visual Masked Autoencoder

Learning high-quality video representation has shown significant applica...
research
01/30/2020

NAViDAd: A No-Reference Audio-Visual Quality Metric Based on a Deep Autoencoder

The development of models for quality prediction of both audio and video...
research
03/24/2020

How deep is your encoder: an analysis of features descriptors for an autoencoder-based audio-visual quality metric

The development of audio-visual quality assessment models poses a number...
research
12/02/2022

Can we still use PEAQ? A Performance Analysis of the ITU Standard for the Objective Assessment of Perceived Audio Quality

The Perceptual Evaluation of Audio Quality (PEAQ) method as described in...
research
08/18/2023

Diff2Lip: Audio Conditioned Diffusion Models for Lip-Synchronization

The task of lip synchronization (lip-sync) seeks to match the lips of hu...
research
06/11/2021

Coded-InvNet for Resilient Prediction Serving Systems

Inspired by a new coded computation algorithm for invertible functions, ...

Please sign up or login with your details

Forgot password? Click here to reset