MorphPool: Efficient Non-linear Pooling Unpooling in CNNs

11/25/2022
by   Rick Groenendijk, et al.
0

Pooling is essentially an operation from the field of Mathematical Morphology, with max pooling as a limited special case. The more general setting of MorphPooling greatly extends the tool set for building neural networks. In addition to pooling operations, encoder-decoder networks used for pixel-level predictions also require unpooling. It is common to combine unpooling with convolution or deconvolution for up-sampling. However, using its morphological properties, unpooling can be generalised and improved. Extensive experimentation on two tasks and three large-scale datasets shows that morphological pooling and unpooling lead to improved predictive performance at much reduced parameter counts.

READ FULL TEXT
research
11/08/2018

Alpha-Pooling for Convolutional Neural Networks

Convolutional neural networks (CNNs) have achieved remarkable performanc...
research
07/13/2022

MorphoActivation: Generalizing ReLU activation function by mathematical morphology

This paper analyses both nonlinear activation functions and spatial max-...
research
10/07/2018

Hartley Spectral Pooling for Deep Learning

In most convolution neural networks (CNNs), downsampling hidden layers i...
research
06/12/2020

Multi Layer Neural Networks as Replacement for Pooling Operations

Pooling operations are a layer found in almost every modern neural netwo...
research
06/14/2021

Learning Deep Morphological Networks with Neural Architecture Search

Deep Neural Networks (DNNs) are generated by sequentially performing lin...
research
01/30/2017

Emergence of Selective Invariance in Hierarchical Feed Forward Networks

Many theories have emerged which investigate how in- variance is generat...

Please sign up or login with your details

Forgot password? Click here to reset