The "Horse" Inside: Seeking Causes Behind the Behaviours of Music Content Analysis Systems

06/09/2016
by   Bob L. Sturm, et al.
0

Building systems that possess the sensitivity and intelligence to identify and describe high-level attributes in music audio signals continues to be an elusive goal, but one that surely has broad and deep implications for a wide variety of applications. Hundreds of papers have so far been published toward this goal, and great progress appears to have been made. Some systems produce remarkable accuracies at recognising high-level semantic concepts, such as music style, genre and mood. However, it might be that these numbers do not mean what they seem. In this paper, we take a state-of-the-art music content analysis system and investigate what causes it to achieve exceptionally high performance in a benchmark music audio dataset. We dissect the system to understand its operation, determine its sensitivities and limitations, and predict the kinds of knowledge it could and could not possess about music. We perform a series of experiments to illuminate what the system has actually learned to do, and to what extent it is performing the intended music listening task. Our results demonstrate how the initial manifestation of music intelligence in this state-of-the-art can be deceptive. Our work provides constructive directions toward developing music content analysis systems that can address the music information and creation needs of real-world users.

READ FULL TEXT

page 3

page 10

page 15

page 21

research
01/01/2021

Audio Content Analysis

Preprint for a book chapter introducing Audio Content Analysis. With a f...
research
11/30/2017

Enabling Embodied Analogies in Intelligent Music Systems

The present methodology is aimed at cross-modal machine learning and use...
research
02/01/2020

Multi-Modal Music Information Retrieval: Augmenting Audio-Analysis with Visual Computing for Improved Music Video Analysis

This thesis combines audio-analysis with computer vision to approach Mus...
research
11/21/2022

A Dataset for Greek Traditional and Folk Music: Lyra

Studying under-represented music traditions under the MIR scope is cruci...
research
12/14/2017

Towards Deep Modeling of Music Semantics using EEG Regularizers

Modeling of music audio semantics has been previously tackled through le...
research
10/23/2019

Graph Representation learning for Audio Music genre Classification

Music genre is arguably one of the most important and discriminative inf...
research
12/07/2018

Towards Effective Exploration/Exploitation in Sequential Music Recommendation

Music streaming companies collectively serve billions of songs per day. ...

Please sign up or login with your details

Forgot password? Click here to reset