Learning to Read and Follow Music in Complete Score Sheet Images

07/21/2020
by   Florian Henkel, et al.
0

This paper addresses the task of score following in sheet music given as unprocessed images. While existing work either relies on OMR software to obtain a computer-readable score representation, or crucially relies on prepared sheet image excerpts, we propose the first system that directly performs score following in full-page, completely unprocessed sheet images. Based on incoming audio and a given image of the score, our system directly predicts the most likely position within the page that matches the audio, outperforming current state-of-the-art image-based score followers in terms of alignment precision. We also compare our method to an OMR-based approach and empirically show that it can be a viable alternative to such a system.

READ FULL TEXT
research
05/10/2021

Multi-modal Conditional Bounding Box Regression for Music Score Following

This paper addresses the problem of sheet-image-based on-line audio-to-s...
research
07/17/2018

Learning to Listen, Read, and Follow: Score Following as a Reinforcement Learning Game

Score following is the process of tracking a musical performance (audio)...
research
11/12/2021

Fully Automatic Page Turning on Real Scores

We present a prototype of an automatic page turning system that works di...
research
08/07/2017

Aktuelle Entwicklungen in der Automatischen Musikverfolgung

In this paper we present current trends in real-time music tracking (a.k...
research
05/06/2022

Musical Score Following and Audio Alignment

Real-time tracking of the position of a musical performance on a musical...
research
10/16/2019

Audio-Conditioned U-Net for Position Estimation in Full Sheet Images

The goal of score following is to track a musical performance, usually i...
research
07/29/2020

Improved Handling of Repeats and Jumps in Audio-Sheet Image Synchronization

This paper studies the problem of automatically generating piano score f...

Please sign up or login with your details

Forgot password? Click here to reset