Timbre Classification of Musical Instruments with a Deep Learning Multi-Head Attention-Based Model

07/13/2021
by   Carlos Hernandez-Olivan, et al.
0

The aim of this work is to define a model based on deep learning that is able to identify different instrument timbres with as few parameters as possible. For this purpose, we have worked with classical orchestral instruments played with different dynamics, which are part of a few instrument families and which play notes in the same pitch range. It has been possible to assess the ability to classify instruments by timbre even if the instruments are playing the same note with the same intensity. The network employed uses a multi-head attention mechanism, with 8 heads and a dense network at the output taking as input the log-mel magnitude spectrograms of the sound samples. This network allows the identification of 20 instrument classes of the classical orchestra, achieving an overall F_1 value of 0.62. An analysis of the weights of the attention layer has been performed and the confusion matrix of the model is presented, allowing us to assess the ability of the proposed architecture to distinguish timbre and to establish the aspects on which future work should focus.

READ FULL TEXT
research
05/03/2021

Deep Neural Network for Musical Instrument Recognition using MFCCs

The task of efficient automatic music classification is of vital importa...
research
09/04/2023

Quid Manumit – Freeing the Qubit for Art

This paper describes how to `Free the Qubit' for art, by creating standa...
research
11/10/2019

Auto-Calibration of Remote Sensing Solar Telescopes with Deep Learning

As a part of NASA's Heliophysics System Observatory (HSO) fleet of satel...
research
05/29/2018

Learning to Transcribe by Ear

Rethinking how to model polyphonic transcription formally, we frame it a...
research
07/09/2019

An Attention Mechanism for Musical Instrument Recognition

While the automatic recognition of musical instruments has seen signific...
research
03/13/2020

Audio inpainting with generative adversarial network

We study the ability of Wasserstein Generative Adversarial Network (WGAN...
research
04/04/2023

A2D: Anywhere Anytime Drumming

The drum kit, which has only been around for around 100 years, is a popu...

Please sign up or login with your details

Forgot password? Click here to reset