A time-scale modification dataset with subjective quality labels

06/01/2020
by   Timothy Roberts, et al.
0

Time Scale Modification (TSM) is a well-researched field; however, no effective objective measure of quality exists. This paper details the creation, subjective evaluation, and analysis of a dataset for use in the development of an objective measure of quality for TSM. Comprised of two parts, the training component contains 88 source files processed using six TSM methods at 10 time scales, while the testing component contains 20 source files processed using three additional methods at four time scales. The source material contains speech, solo harmonic and percussive instruments, sound effects, and a range of music genres. Ratings (42 529) were collected from 633 sessions using laboratory and remote collection methods. Analysis of results shows no correlation between age and quality of rating; expert and non-expert listeners to be equivalent; minor differences between participants with and without hearing issues; and minimal differences between testing modalities. A comparison of published objective measures and subjective scores shows the objective measures to be poor indicators of subjective quality. Initial results for a retrained objective measure of quality are presented with results approaching average root mean squared error loss and Pearson correlation values of subjective sessions. The labeled dataset is available at http://ieee-dataport.org/1987.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/11/2020

An Objective Measure of Quality for Time-Scale Modification of Audio

Objective evaluation of audio processed with Time-Scale Modification (TS...
research
09/07/2020

Deep Learning-Based Single-Ended Objective Quality Measures for Time-Scale Modified Audio

Objective evaluation of audio processed with Time-Scale Modification (TS...
research
10/25/2020

Crowdsourcing approach for subjective evaluation of echo impairment

The quality of acoustic echo cancellers (AECs) in real-time communicatio...
research
09/11/2020

Aligning Subjective Ratings in Clinical Decision Making

In addition to objective indicators (e.g. laboratory values), clinical d...
research
07/31/2021

Subjective Image Quality Assessment with Boosted Triplet Comparisons

In subjective full-reference image quality assessment, differences betwe...
research
04/17/2021

Comparison of remote experiments using crowdsourcing and laboratory experiments on speech intelligibility

Many subjective experiments have been performed to develop objective spe...
research
08/02/2018

Toward A Deep Understanding of What Makes a Scientific Visualization Memorable

We report results from a preliminary study exploring the memorability of...

Please sign up or login with your details

Forgot password? Click here to reset