Polyphonic Piano Transcription Using Autoregressive Multi-State Note Model

10/02/2020
by   Taegyun Kwon, et al.
0

Recent advances in polyphonic piano transcription have been made primarily by a deliberate design of neural network architectures that detect different note states such as onset or sustain and model the temporal evolution of the states. The majority of them, however, use separate neural networks for each note state, thereby optimizing multiple loss functions, and also they handle the temporal evolution of note states by abstract connections between the state-wise neural networks or using a post-processing module. In this paper, we propose a unified neural network architecture where multiple note states are predicted as a softmax output with a single loss function and the temporal order is learned by an auto-regressive connection within the single neural network. This compact model allows to increase note states without architectural complexity. Using the MAESTRO dataset, we examine various combinations of multiple note states including on, onset, sustain, re-onset, offset, and off. We also show that the autoregressive module effectively learns inter-state dependency of notes. Finally, we show that our proposed model achieves performance comparable to state-of-the-arts with fewer parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2017

Investigation on the use of Hidden-Markov Models in automatic transcription of music

Hidden Markov Models (HMMs) are a ubiquitous tool to model time series d...
research
07/04/2019

Deep Saliency Models : The Quest For The Loss Function

Recent advances in deep learning have pushed the performances of visual ...
research
08/18/2020

Generating Music with a Self-Correcting Non-Chronological Autoregressive Model

We describe a novel approach for generating music using a self-correctin...
research
06/21/2019

Deep Polyphonic ADSR Piano Note Transcription

We investigate a late-fusion approach to piano transcription, combined w...
research
04/21/2021

Scaling of neural-network quantum states for time evolution

Simulating quantum many-body dynamics on classical computers is a challe...
research
07/07/2023

Roman Numeral Analysis with Graph Neural Networks: Onset-wise Predictions from Note-wise Features

Roman Numeral analysis is the important task of identifying chords and t...
research
04/19/2023

Loss minimization yields multicalibration for large neural networks

Multicalibration is a notion of fairness that aims to provide accurate p...

Please sign up or login with your details

Forgot password? Click here to reset