Pooling Methods in Deep Neural Networks, a Review

09/16/2020
by   Hossein Gholamalinezhad, et al.
68

Nowadays, Deep Neural Networks are among the main tools used in various sciences. Convolutional Neural Network is a special type of DNN consisting of several convolution layers, each followed by an activation function and a pooling layer. The pooling layer is an important layer that executes the down-sampling on the feature maps coming from the previous layer and produces new feature maps with a condensed resolution. This layer drastically reduces the spatial dimension of input. It serves two main purposes. The first is to reduce the number of parameters or weights, thus lessening the computational cost. The second is to control the overfitting of the network. An ideal pooling method is expected to extract only useful information and discard irrelevant details. There are a lot of methods for the implementation of pooling operation in Deep Neural Networks. In this paper, we reviewed some of the famous and useful pooling methods.

READ FULL TEXT

page 7

page 8

page 10

page 12

research
07/26/2019

Universal Pooling -- A New Pooling Method for Convolutional Neural Networks

Pooling is one of the main elements in convolutional neural networks. Th...
research
06/12/2020

Multi Layer Neural Networks as Replacement for Pooling Operations

Pooling operations are a layer found in almost every modern neural netwo...
research
11/13/2018

Vehicle Re-identification Using Quadruple Directional Deep Learning Features

In order to resist the adverse effect of viewpoint variations for improv...
research
04/29/2021

Condensation-Net: Memory-Efficient Network Architecture with Cross-Channel Pooling Layers and Virtual Feature Maps

"Lightweight convolutional neural networks" is an important research top...
research
07/13/2020

Deep Neural-Kernel Machines

In this chapter we review the main literature related to the recent adva...
research
04/23/2018

N-fold Superposition: Improving Neural Networks by Reducing the Noise in Feature Maps

Considering the use of Fully Connected (FC) layer limits the performance...
research
12/16/2013

Network In Network

We propose a novel deep network structure called "Network In Network" (N...

Please sign up or login with your details

Forgot password? Click here to reset