Validity in Music Information Research Experiments

01/04/2023
by   Bob L. T. Sturm, et al.
0

Validity is the truth of an inference made from evidence, such as data collected in an experiment, and is central to working scientifically. Given the maturity of the domain of music information research (MIR), validity in our opinion should be discussed and considered much more than it has been so far. Considering validity in one's work can improve its scientific and engineering value. Puzzling MIR phenomena like adversarial attacks and performance glass ceilings become less mysterious through the lens of validity. In this article, we review the subject of validity in general, considering the four major types of validity from a key reference: Shadish et al. 2002. We ground our discussion of these types with a prototypical MIR experiment: music classification using machine learning. Through this MIR experimentalists can be guided to make valid inferences from data collected from their experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/29/2020

End-to-End Adversarial White Box Attacks on Music Instrument Classification

Small adversarial perturbations of input data are able to drastically ch...
research
07/28/2020

Towards Ecologically Valid Research on Language User Interfaces

Language User Interfaces (LUIs) could improve human-machine interaction ...
research
04/27/2021

Coinductive Validity

This note formally defines the concept of coinductive validity of judgem...
research
06/08/2023

Improving the Reporting of Threats to Construct Validity

Background: Construct validity concerns the use of indicators to measure...
research
01/20/2022

Kinit Classification in Ethiopian Chants, Azmaris and Modern Music: A New Dataset and CNN Benchmark

In this paper, we create EMIR, the first-ever Music Information Retrieva...
research
01/25/2023

Evidence Profiles for Validity Threats in Program Comprehension Experiments

Searching for clues, gathering evidence, and reviewing case files are al...
research
06/18/2023

Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators

In this article we develop a feasible version of the assumption-lean tes...

Please sign up or login with your details

Forgot password? Click here to reset