AECMOS: A speech quality assessment metric for echo impairment

10/06/2021
by   Marju Purin, et al.
0

Traditionally, the quality of acoustic echo cancellers is evaluated using intrusive speech quality assessment measures such as ERLE <cit.> and PESQ <cit.>, or by carrying out subjective laboratory tests. Unfortunately, the former are not well correlated with human subjective measures, while the latter are time and resource consuming to carry out. We provide a new tool for speech quality assessment for echo impairment which can be used to evaluate the performance of acoustic echo cancellers. More precisely, we develop a neural network model to evaluate call quality degradations in two separate categories: echo and degradations from other sources. We show that our model is accurate as measured by correlation with human subjective quality ratings. Our tool can be used effectively to stack rank echo cancellation models. AECMOS is being made publicly available as an Azure service.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2023

PLCMOS – a data-driven non-intrusive metric for the evaluation of packet loss concealment algorithms

Speech quality assessment is a problem for every researcher working on m...
research
10/25/2020

Crowdsourcing approach for subjective evaluation of echo impairment

The quality of acoustic echo cancellers (AECs) in real-time communicatio...
research
09/14/2023

Multi-dimensional Speech Quality Assessment in Crowdsourcing

Subjective speech quality assessment is the gold standard for evaluating...
research
03/12/2018

Full Reference Objective Quality Assessment for Reconstructed Background Images

With an increased interest in applications that require a clean backgrou...
research
06/01/2017

Data Analysis in Multimedia Quality Assessment: Revisiting the Statistical Tests

Assessment of multimedia quality relies heavily on subjective assessment...
research
03/26/2020

Speech Quality Factors for Traditional and Neural-Based Low Bit Rate Vocoders

This study compares the performances of different algorithms for coding ...
research
05/03/2023

Datasheet for Subjective and Objective Quality Assessment Datasets

Over the years, many subjective and objective quality assessment dataset...

Please sign up or login with your details

Forgot password? Click here to reset