Efficient Convolutional Network Learning using Parametric Log based Dual-Tree Wavelet ScatterNet

08/30/2017
by   Amarjot Singh, et al.
0

We propose a DTCWT ScatterNet Convolutional Neural Network (DTSCNN) formed by replacing the first few layers of a CNN network with a parametric log based DTCWT ScatterNet. The ScatterNet extracts edge based invariant representations that are used by the later layers of the CNN to learn high-level features. This improves the training of the network as the later layers can learn more complex patterns from the start of learning because the edge representations are already present. The efficient learning of the DTSCNN network is demonstrated on CIFAR-10 and Caltech-101 datasets. The generic nature of the ScatterNet front-end is shown by an equivalent performance to pre-trained CNN front-ends. A comparison with the state-of-the-art on CIFAR-10 and Caltech-101 datasets is also presented.

READ FULL TEXT
research
12/01/2017

Utilizing Domain Knowledge in End-to-End Audio Processing

End-to-end neural network based approaches to audio modelling are genera...
research
08/15/2017

Learning with Rethinking: Recurrently Improving Convolutional Neural Networks through Feedback

Recent years have witnessed the great success of convolutional neural ne...
research
02/15/2018

Tree-CNN: A Deep Convolutional Neural Network for Lifelong Learning

In recent years, Convolutional Neural Networks (CNNs) have shown remarka...
research
11/28/2018

WaveletNet: Logarithmic Scale Efficient Convolutional Neural Networks for Edge Devices

We present a logarithmic-scale efficient convolutional neural network ar...
research
11/09/2015

Visual Language Modeling on CNN Image Representations

Measuring the naturalness of images is important to generate realistic i...
research
10/11/2021

Decomposing Convolutional Neural Networks into Reusable and Replaceable Modules

Training from scratch is the most common way to build a Convolutional Ne...
research
08/17/2020

An Improved Dilated Convolutional Network for Herd Counting in Crowded Scenes

Crowd management technologies that leverage computer vision are widespre...

Please sign up or login with your details

Forgot password? Click here to reset