Transfer of knowledge among instruments in automatic music transcription

04/30/2023
by   Michał Leś, et al.
0

Automatic music transcription (AMT) is one of the most challenging tasks in the music information retrieval domain. It is the process of converting an audio recording of music into a symbolic representation containing information about the notes, chords, and rhythm. Current research in this domain focuses on developing new models based on transformer architecture or using methods to perform semi-supervised training, which gives outstanding results, but the computational cost of training such models is enormous. This work shows how to employ easily generated synthesized audio data produced by software synthesizers to train a universal model. It is a good base for further transfer learning to quickly adapt transcription model for other instruments. Achieved results prove that using synthesized data for training may be a good base for pretraining general-purpose models, where the task of transcription is not focused on one instrument.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2021

Omnizart: A General Toolbox for Automatic Music Transcription

We present and release Omnizart, a new Python library that provides a st...
research
11/04/2021

MT3: Multi-Task Multitrack Music Transcription

Automatic Music Transcription (AMT), inferring musical notes from raw au...
research
09/19/2023

Motif-Centric Representation Learning for Symbolic Music

Music motif, as a conceptual building block of composition, is crucial f...
research
12/04/2022

Melody transcription via generative pre-training

Despite the central role that melody plays in music perception, it remai...
research
07/13/2021

Towards Automatic Instrumentation by Learning to Separate Parts in Symbolic Multitrack Music

Modern keyboards allow a musician to play multiple instruments at the sa...
research
04/12/2023

A Phoneme-Informed Neural Network Model for Note-Level Singing Transcription

Note-level automatic music transcription is one of the most representati...
research
11/26/2020

Real-time error correction and performance aid for MIDI instruments

Making a slight mistake during live music performance can easily be spot...

Please sign up or login with your details

Forgot password? Click here to reset