Improving the Resolution of CNN Feature Maps Efficiently with Multisampling

05/28/2018
by   Shayan Sadigh, et al.
0

We describe a new class of subsampling techniques for CNNs, termed multisampling, that significantly increases the amount of information kept by feature maps through subsampling layers. One version of our method, which we call checkered subsampling, significantly improves the accuracy of state-of-the-art architectures such as DenseNet and ResNet without any additional parameters and, remarkably, improves the accuracy of certain pretrained ImageNet models without any training or fine-tuning. We glean new insight into the nature of data augmentations and demonstrate, for the first time, that coarse feature maps are significantly bottlenecking the performance of neural networks in image classification.

READ FULL TEXT
research
01/14/2020

The problems with using STNs to align CNN feature maps

Spatial transformer networks (STNs) were designed to enable CNNs to lear...
research
03/11/2019

Accuracy Booster: Performance Boosting using Feature Map Re-calibration

Convolution Neural Networks (CNN) have been extremely successful in solv...
research
02/27/2020

NeurIPS 2019 Disentanglement Challenge: Improved Disentanglement through Learned Aggregation of Convolutional Feature Maps

This report to our stage 2 submission to the NeurIPS 2019 disentanglemen...
research
05/28/2017

Dilated Residual Networks

Convolutional networks for image classification progressively reduce res...
research
11/22/2021

Adaptive Transfer Learning: a simple but effective transfer learning

Transfer learning (TL) leverages previously obtained knowledge to learn ...
research
01/31/2021

Spectral Roll-off Points: Estimating Useful Information Under the Basis of Low-frequency Data Representations

Useful information is the basis for model decisions. Estimating useful i...
research
02/03/2023

Cluster-CAM: Cluster-Weighted Visual Interpretation of CNNs' Decision in Image Classification

Despite the tremendous success of convolutional neural networks (CNNs) i...

Please sign up or login with your details

Forgot password? Click here to reset