Wavelet Neural Networks versus Wavelet-based Neural Networks

11/01/2022
by   Lubomir T. Dechevsky, et al.
0

This is the first paper in a sequence of studies in which we introduce a new type of neural networks (NNs) – wavelet-based neural networks (WBNNs) – and study their properties and potential for applications. We begin this study with a comparison to the currently existing type of wavelet neural networks (WNNs) and show that WBNNs vastly outperform WNNs. One reason for the vast superiority of WBNNs is their advanced hierarchical tree structure based on biorthonormal multiresolution analysis (MRA). Another reason for this is the implementation of our new idea to incorporate the wavelet tree depth into the neural width of the NN. The separation of the roles of wavelet depth and neural depth provides a conceptually and algorithmically simple but highly efficient methodology for sharp increase in functionality of swarm and deep WBNNs and rapid acceleration of the machine learning process.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2020

Towards deep neural network compression via learnable wavelet transforms

Wavelets are well known for data compression, yet have rarely been appli...
research
06/24/2004

Self-organizing neural networks in classification and image recognition

Self-organizing neural networks are used for brick finding in OPERA expe...
research
08/29/2018

Wavelet based edge feature enhancement for convolutional neural networks

Convolutional neural networks are able to perform a hierarchical learnin...
research
02/19/2020

Translating Between Wavelet Tree and Wavelet Matrix Construction

The wavelet tree (Grossi et al. [SODA, 2003]) and wavelet matrix (Claude...
research
01/01/2022

Wavelet Transparency

Order-independent transparency schemes rely on low-order approximations ...
research
06/09/2020

Wavelet Networks: Scale Equivariant Learning From Raw Waveforms

Inducing symmetry equivariance in deep neural architectures has resolved...
research
11/04/2021

Imagine Networks

In this paper, we introduce an Imagine Network that can simulate itself ...

Please sign up or login with your details

Forgot password? Click here to reset