Structure-Aware Audio-to-Score Alignment using Progressively Dilated Convolutional Neural Networks

01/31/2021
by   Ruchit Agrawal, et al.
0

The identification of structural differences between a music performance and the score is a challenging yet integral step of audio-to-score alignment, an important subtask of music information retrieval. We present a novel method to detect such differences between the score and performance for a given piece of music using progressively dilated convolutional neural networks. Our method incorporates varying dilation rates at different layers to capture both short-term and long-term context, and can be employed successfully in the presence of limited annotated data. We conduct experiments on audio recordings of real performances that differ structurally from the score, and our results demonstrate that our models outperform standard methods for structure-aware audio-to-score alignment.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 5

07/28/2020

A Hybrid Approach to Audio-to-Score Alignment

Audio-to-score alignment aims at generating an accurate mapping between ...
02/18/2021

Low Resource Audio-to-Lyrics Alignment From Polyphonic Music Recordings

Lyrics alignment in long music recordings can be memory exhaustive when ...
06/29/2018

Exploratory Analysis of a Large Flamenco Corpus using an Ensemble of Convolutional Neural Networks as a Structural Annotation Backend

We present computational tools that we developed for the analysis of a l...
04/19/2022

A Convolutional-Attentional Neural Framework for Structure-Aware Performance-Score Synchronization

Performance-score synchronization is an integral task in signal processi...
11/15/2020

Learning Frame Similarity using Siamese networks for Audio-to-Score Alignment

Audio-to-score alignment aims at generating an accurate mapping between ...
10/16/2019

A Study of Annotation and Alignment Accuracy for Performance Comparison in Complex Orchestral Music

Quantitative analysis of commonalities and differences between recorded ...
06/19/2020

Towards Reliable Real-time Opera Tracking: Combining Alignment with Audio Event Detectors to Increase Robustness

Recent advances in real-time music score following have made it possible...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.