Deep convolutional neural networks for predominant instrument recognition in polyphonic music

05/31/2016
by   Yoonchang Han, et al.
0

Identifying musical instruments in polyphonic music recordings is a challenging but important problem in the field of music information retrieval. It enables music search by instrument, helps recognize musical genres, or can make music transcription easier and more accurate. In this paper, we present a convolutional neural network framework for predominant instrument recognition in real-world polyphonic music. We train our network from fixed-length music excerpts with a single-labeled predominant instrument and estimate an arbitrary number of predominant instruments from an audio signal with a variable length. To obtain the audio-excerpt-wise result, we aggregate multiple outputs from sliding windows over the test audio. In doing so, we investigated two different aggregation methods: one takes the average for each instrument and the other takes the instrument-wise sum followed by normalization. In addition, we conducted extensive experiments on several important factors that affect the performance, including analysis window size, identification threshold, and activation functions for neural networks to find the optimal set of parameters. Using a dataset of 10k audio excerpts from 11 instruments for evaluation, we found that convolutional neural networks are more robust than conventional methods that exploit spectral features and source separation with support vector machines. Experimental results showed that the proposed convolutional network architecture obtained an F1 measure of 0.602 for micro and 0.503 for macro, respectively, achieving 19.6 compared with other state-of-the-art algorithms.

READ FULL TEXT

page 7

page 8

page 9

page 11

research
05/03/2021

Deep Neural Network for Musical Instrument Recognition using MFCCs

The task of efficient automatic music classification is of vital importa...
research
11/17/2015

Automatic Instrument Recognition in Polyphonic Music Using Convolutional Neural Networks

Traditional methods to tackle many music information retrieval tasks typ...
research
11/16/2022

Structural Segmentation and Labeling of Tabla Solo Performances

Tabla is a North Indian percussion instrument used as an accompaniment a...
research
07/28/2021

Pitch-Informed Instrument Assignment Using a Deep Convolutional Network with Multiple Kernel Shapes

This paper proposes a deep convolutional neural network for performing n...
research
09/16/2019

Musical Instrument Classification via Low-Dimensional Feature Vectors

Music is a mysterious language that conveys feeling and thoughts via dif...
research
01/12/2018

Separation of Instrument Sounds using Non-negative Matrix Factorization with Spectral Envelope Constraints

Spectral envelope is one of the most important features that characteriz...
research
10/08/2020

All for One and One for All: Improving Music Separation by Bridging Networks

This paper proposes several improvements for music separation with deep ...

Please sign up or login with your details

Forgot password? Click here to reset