Between Homomorphic Signal Processing and Deep Neural Networks: Constructing Deep Algorithms for Polyphonic Music Transcription

06/26/2017
by   Li Su, et al.
0

This paper presents a new approach in understanding how deep neural networks (DNNs) work by applying homomorphic signal processing techniques. Focusing on the task of multi-pitch estimation (MPE), this paper demonstrates the equivalence relation between a generalized cepstrum and a DNN in terms of their structures and functionality. Such an equivalence relation, together with pitch perception theories and the recently established rectified-correlations-on-a-sphere (RECOS) filter analysis, provide an alternative way in explaining the role of the nonlinear activation function and the multi-layer structure, both of which exist in a cepstrum and a DNN. To validate the efficacy of this new approach, a new feature designed in the same fashion is proposed for pitch salience function. The new feature outperforms the one-layer spectrum in the MPE task and, as predicted, it addresses the issue of the missing fundamental effect and also achieves better robustness to noise.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/26/2011

Multi Layer Analysis

This thesis presents a new methodology to analyze one-dimensional signal...
research
02/10/2019

Performance Advantages of Deep Neural Networks for Angle of Arrival Estimation

The problem of estimating the number of sources and their angles of arri...
research
07/15/2021

Training for temporal sparsity in deep neural networks, application in video processing

Activation sparsity improves compute efficiency and resource utilization...
research
06/01/2018

Machines hear better when they have ears

Deep-neural-network (DNN) based noise suppression systems yield signific...
research
06/28/2020

Frequency learning for image classification

Machine learning applied to computer vision and signal processing is ach...
research
09/14/2016

Understanding Convolutional Neural Networks with A Mathematical Model

This work attempts to address two fundamental questions about the struct...

Please sign up or login with your details

Forgot password? Click here to reset