An Analysis Method for Metric-Level Switching in Beat Tracking

10/13/2022
by   Ching-Yu Chiu, et al.
0

For expressive music, the tempo may change over time, posing challenges to tracking the beats by an automatic model. The model may first tap to the correct tempo, but then may fail to adapt to a tempo change, or switch between several incorrect but perceptually plausible ones (e.g., half- or double-tempo). Existing evaluation metrics for beat tracking do not reflect such behaviors, as they typically assume a fixed relationship between the reference beats and estimated beats. In this paper, we propose a new performance analysis method, called annotation coverage ratio (ACR), that accounts for a variety of possible metric-level switching behaviors of beat trackers. The idea is to derive sequences of modified reference beats of all metrical levels for every two consecutive reference beats, and compare every sequence of modified reference beats to the subsequences of estimated beats. We show via experiments on three datasets of different genres the usefulness of ACR when utilized alongside existing metrics, and discuss the new insights to be gained.

READ FULL TEXT
research
02/17/2022

Revisiting the Evaluation Metrics of Paraphrase Generation

Paraphrase generation is an important NLP task that has achieved signifi...
research
12/24/2020

LCEval: Learned Composite Metric for Caption Evaluation

Automatic evaluation metrics hold a fundamental importance in the develo...
research
08/20/2023

Local Periodicity-Based Beat Tracking for Expressive Classical Piano Music

To model the periodicity of beats, state-of-the-art beat tracking system...
research
12/29/2017

Objective evaluation metrics for automatic classification of EEG events

The evaluation of machine learning algorithms in biomedical fields for a...
research
05/18/2023

CLEME: Debiasing Multi-reference Evaluation for Grammatical Error Correction

It is intractable to evaluate the performance of Grammatical Error Corre...
research
08/07/2019

Visual Coin-Tracking: Tracking of Planar Double-Sided Objects

We introduce a new video analysis problem -- tracking of rigid planar ob...

Please sign up or login with your details

Forgot password? Click here to reset