Deep Scattering Network with Max-pooling

01/07/2021
by   Taekyung Ki, et al.
0

Scattering network is a convolutional network, consisting of cascading convolutions using pre-defined wavelets followed by the modulus operator. Since its introduction in 2012, the scattering network is used as one of few mathematical tools explaining components of the convolutional neural networks (CNNs). However, a pooling operator, which is one of main components of conventional CNNs, is not considered in the original scattering network. In this paper, we propose a new network, called scattering-maxp network, integrating the scattering network with the max-pooling operator. We model continuous max-pooling, apply it to the scattering network, and get the scattering-maxp network. We show that the scattering-maxp network shares many useful properties of the scattering network including translation invariance, but with much smaller number of parameters. Numerical experiments show that the use of scattering-maxp does not degrade the performance too much and is much faster than the original one, in image classification tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2013

Deep Learning by Scattering

We introduce general scattering transforms as mathematical models of dee...
research
09/05/2017

Visualizing and Improving Scattering Networks

Scattering Transforms (or ScatterNets) introduced by Mallat are a promis...
research
06/10/2019

A Closed-Form Learned Pooling for Deep Classification Networks

In modern computer vision tasks, convolutional neural networks (CNNs) ar...
research
06/17/2019

PolSAR Image Classification based on Polarimetric Scattering Coding and Sparse Support Matrix Machine

POLSAR image has an advantage over optical image because it can be acqui...
research
11/30/2021

How to quantify fields or textures? A guide to the scattering transform

Extracting information from stochastic fields or textures is a ubiquitou...
research
09/17/2018

Scattering Networks for Hybrid Representation Learning

Scattering networks are a class of designed Convolutional Neural Network...
research
03/27/2017

Scaling the Scattering Transform: Deep Hybrid Networks

We use the scattering network as a generic and fixed ini-tialization of ...

Please sign up or login with your details

Forgot password? Click here to reset