Polyphonic Sound Event Detection by using Capsule Neural Networks

10/15/2018
by   Fabio Vesperini, et al.
0

Artificial sound event detection (SED) has the aim to mimic the human ability to perceive and understand what is happening in the surroundings. Nowadays, Deep Learning offers valuable techniques for this goal such as Convolutional Neural Networks (CNNs). The Capsule Neural Network (CapsNet) architecture has been recently introduced in the image processing field with the intent to overcome some of the known limitations of CNNs, specifically regarding the scarce robustness to affine transformations (i.e., perspective, size, orientation) and the detection of overlapped images. This motivated the authors to employ CapsNets to deal with the polyphonic-SED task, in which multiple sound events occur simultaneously. Specifically, we propose to exploit the capsule units to represent a set of distinctive properties for each individual sound event. Capsule units are connected through a so-called "dynamic routing" that encourages learning part-whole relationships and improves the detection performance in a polyphonic context. This paper reports extensive evaluations carried out on three publicly available datasets, showing how the CapsNet-based algorithm not only outperforms standard CNNs but also allows to achieve the best results with respect to the state of the art algorithms.

READ FULL TEXT

page 1

page 5

page 8

page 12

research
10/15/2018

Polyphonic Sound Event Detection by using Capsule Neural Network

Artificial sound event detection (SED) has the aim to mimic the human ab...
research
07/19/2018

A Capsule based Approach for Polyphonic Sound Event Detection

Polyphonic sound event detection (polyphonic SED) is an interesting but ...
research
06/12/2018

Capsule Routing for Sound Event Detection

The detection of acoustic scenes is a challenging problem in which envir...
research
11/18/2019

Improving the Robustness of Capsule Networks to Image Affine Transformations

Convolutional neural networks (CNNs) achieve translational invariance us...
research
11/25/2021

Polyphonic Sound Event Detection Using Capsule Neural Network on Multi-Type-Multi-Scale Time-Frequency Representation

The challenges of polyphonic sound event detection (PSED) stem from the ...
research
06/06/2022

Learning with Capsules: A Survey

Capsule networks were proposed as an alternative approach to Convolution...
research
04/09/2019

Assessing Capsule Networks With Biased Data

Machine learning based methods achieves impressive results in object cla...

Please sign up or login with your details

Forgot password? Click here to reset