Beyond chord vocabularies: Exploiting pitch-relationships in a chord estimation metric

01/13/2022
by   Johanna Devaney, et al.
0

Chord estimation metrics treat chord labels as independent of one another. This fails to represent the pitch relationships between the chords in a meaningful way, resulting in evaluations that must make compromises with complex chord vocabularies and that often require time-consuming qualitative analyses to determine details about how a chord estimation algorithm performs. This paper presents an accuracy metric for chord estimation that compares the pitch content of the estimated chords against the ground truth that captures both the correct notes that are estimated and additional notes that are inserted into the estimate. This is not a stand-alone evaluation protocol but rather a metric that can be integrated as a weighting into existing evaluation approaches.

READ FULL TEXT

page 1

page 2

page 3

research
04/01/2022

Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation

In recent years, machine learning models have rapidly become better at g...
research
01/25/2021

A metric for evaluating 3D reconstruction and mapping performance with no ground truthing

It is not easy when evaluating 3D mapping performance because existing m...
research
12/01/2021

Lecture notes on complexity of quantifier elimination over the reals

These are lecture notes for a course I gave in mid-1990s for MSc student...
research
04/11/2022

Towards Automatically Generating Release Notes using Extractive Summarization Technique

Release notes are admitted as an essential document by practitioners. Th...
research
07/06/2021

Comparing PCG metrics with Human Evaluation in Minecraft Settlement Generation

There are a range of metrics that can be applied to the artifacts produc...
research
09/12/2023

Rethinking Evaluation Metric for Probability Estimation Models Using Esports Data

Probability estimation models play an important role in various fields, ...
research
12/10/2022

What's Wrong with the Absolute Trajectory Error?

One of the main limitations of the commonly used Absolute Trajectory Err...

Please sign up or login with your details

Forgot password? Click here to reset