Can we still use PEAQ? A Performance Analysis of the ITU Standard for the Objective Assessment of Perceived Audio Quality

12/02/2022
by   Pablo M. Delgado, et al.
0

The Perceptual Evaluation of Audio Quality (PEAQ) method as described in the International Telecommunication Union (ITU) recommendation ITU-R BS.1387 has been widely used for computationally estimating the quality of perceptually coded audio signals without the need for extensive subjective listening tests. However, many reports have highlighted clear limitations of the scheme after the end of its standardization, particularly involving signals coded with newer technologies such as bandwidth extension or parametric multi-channel coding. Until now, no other method for measuring the quality of both speech and audio signals has been standardized by the ITU. Therefore, a further investigation of the causes for these limitations would be beneficial to a possible update of said scheme. Our experimental results indicate that the performance of PEAQ's model of disturbance loudness is still as good as (and sometimes superior to) other state-of-the-art objective measures, albeit with varying performance depending on the type of degraded signal content (i.e. speech or music). This finding evidences the need for an improved cognitive model. In addition, results indicate that an updated mapping of Model Output Values (MOVs) to PEAQ's Distortion Index (DI) based on newer training data can greatly improve performance. Finally, some suggestions for the improvement of PEAQ are provided based on the reported results and comparison to other systems.

READ FULL TEXT
research
07/13/2023

An Improved Metric of Informational Masking for Perceptual Audio Quality Measurement

Perceptual audio quality measurement systems algorithmically analyze the...
research
10/29/2019

A novel fuzzy logic-based metric for audio quality assessment: Objective audio quality assessment

ITU-R BS.1387 states a method for objective assessment of perceived audi...
research
12/08/2022

A Data-driven Cognitive Salience Model for Objective Perceptual Audio Quality Assessment

Objective audio quality measurement systems often use perceptual models ...
research
12/02/2022

Objective Assessment of Spatial Audio Quality using Directional Loudness Maps

This work introduces a feature extracted from stereophonic/binaural audi...
research
10/21/2021

Objective Measures of Perceptual Audio Quality Reviewed: An Evaluation of Their Application Domain Dependence

Over the past few decades, computational methods have been developed to ...
research
08/07/2023

AudioVMAF: Audio Quality Prediction with VMAF

Video Multimethod Assessment Fusion (VMAF) [1], [2], [3] is a popular to...
research
08/31/2022

Evaluating generative audio systems and their metrics

Recent years have seen considerable advances in audio synthesis with dee...

Please sign up or login with your details

Forgot password? Click here to reset