Ordinal Pooling Networks: For Preserving Information over Shrinking Feature Maps

04/08/2018
by   Ashwani Kumar, et al.
0

In the framework of convolutional neural networks that lie at the heart of deep learning, downsampling is often performed with a max-pooling operation that however completely discards the information from other activations in a pooling region. To address this issue, a novel pooling scheme, Ordinal Pooling Network (OPN), is introduced in this work. OPN rearranges all the elements of a pooling region in a sequence and assigns different weights to all the elements based upon their orders in the sequence, where the weights are learned via the gradient-based optimisation. The results of our small-scale experiments on image classification task on MNIST database demonstrate that this scheme leads to a consistent improvement in the accuracy over max-pooling operation. This improvement is expected to increase in the deep networks, where several layers of pooling become necessary.

READ FULL TEXT
research
09/03/2021

Ordinal Pooling

In the framework of convolutional neural networks, downsampling is often...
research
07/06/2016

CUNet: A Compact Unsupervised Network for Image Classification

In this paper, we propose a compact network called CUNet (compact unsupe...
research
08/12/2019

LIP: Local Importance-based Pooling

Spatial downsampling layers are favored in convolutional neural networks...
research
11/02/2021

LogAvgExp Provides a Principled and Performant Global Pooling Operator

We seek to improve the pooling operation in neural networks, by applying...
research
03/03/2020

multi-patch aggregation models for resampling detection

Images captured nowadays are of varying dimensions with smartphones and ...
research
04/02/2021

LiftPool: Bidirectional ConvNet Pooling

Pooling is a critical operation in convolutional neural networks for inc...
research
07/02/2020

Learning ordered pooling weights in image classification

Spatial pooling is an important step in computer vision systems like Con...

Please sign up or login with your details

Forgot password? Click here to reset