Transforming Musical Signals through a Genre Classifying Convolutional Neural Network

06/29/2017
by   S. Geng, et al.
0

Convolutional neural networks (CNNs) have been successfully applied on both discriminative and generative modeling for music-related tasks. For a particular task, the trained CNN contains information representing the decision making or the abstracting process. One can hope to manipulate existing music based on this 'informed' network and create music with new features corresponding to the knowledge obtained by the network. In this paper, we propose a method to utilize the stored information from a CNN trained on musical genre classification task. The network was composed of three convolutional layers, and was trained to classify five-second song clips into five different genres. After training, randomly selected clips were modified by maximizing the sum of outputs from the network layers. In addition to the potential of such CNNs to produce interesting audio transformation, more information about the network and the original music could be obtained from the analysis of the generated features since these features indicate how the network 'understands' the music.

READ FULL TEXT

page 1

page 2

research
07/08/2016

Explaining Deep Convolutional Neural Networks on Music Classification

Deep convolutional neural networks (CNNs) have been actively adopted in ...
research
12/22/2017

Music Genre Classification with Paralleling Recurrent Convolutional Neural Network

Deep learning has been demonstrated its effectiveness and efficiency in ...
research
01/24/2019

Bottom-up Broadcast Neural Network For Music Genre Classification

Music genre recognition based on visual representation has been successf...
research
08/16/2018

Genre-Agnostic Key Classification With Convolutional Neural Networks

We propose modifications to the model structure and training procedure t...
research
12/08/2017

Representations of Sound in Deep Learning of Audio Features from Music

The work of a single musician, group or composer can vary widely in term...
research
07/03/2019

A Case Study of Deep-Learned Activations via Hand-Crafted Audio Features

The explainability of Convolutional Neural Networks (CNNs) is a particul...
research
02/10/2020

Modeling Musical Onset Probabilities via Neural Distribution Learning

Musical onset detection can be formulated as a time-to-event (TTE) or ti...

Please sign up or login with your details

Forgot password? Click here to reset