Multi-Path Learnable Wavelet Neural Network for Image Classification

08/26/2019
by   D. D. N. De Silva, et al.
13

Despite the remarkable success of deep learning in pattern recognition, deep network models face the problem of training a large number of parameters. In this paper, we propose and evaluate a novel multi-path wavelet neural network architecture for image classification with far less number of trainable parameters. The model architecture consists of a multi-path layout with several levels of wavelet decompositions performed in parallel followed by fully connected layers. These decomposition operations comprise wavelet neurons with learnable parameters, which are updated during the training phase using the back-propagation algorithm. We evaluate the performance of the introduced network using common image datasets without data augmentation except for SVHN and compare the results with influential deep learning models. Our findings support the possibility of reducing the number of parameters significantly in deep neural networks without compromising its accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/23/2018

Multilevel Wavelet Decomposition Network for Interpretable Time Series Analysis

Recent years have witnessed the unprecedented rising of time series from...
research
04/20/2020

Towards deep neural network compression via learnable wavelet transforms

Wavelets are well known for data compression, yet have rarely been appli...
research
06/17/2020

Using Wavelets and Spectral Methods to Study Patterns in Image-Classification Datasets

Deep learning models extract, before a final classification layer, featu...
research
11/17/2015

Learning Neural Network Architectures using Backpropagation

Deep neural networks with millions of parameters are at the heart of man...
research
01/06/2020

Express Wavenet – a low parameter optical neural network with random shift wavelet pattern

Express Wavenet is an improved optical diffractive neural network. At ea...
research
12/07/2020

Why Unsupervised Deep Networks Generalize

Promising resolutions of the generalization puzzle observe that the actu...
research
12/10/2019

Deep Adaptive Wavelet Network

Even though convolutional neural networks have become the method of choi...

Please sign up or login with your details

Forgot password? Click here to reset