Exploiting Features with Split-and-Share Module

08/10/2021
by   Jaemin Lee, et al.
4

Deep convolutional neural networks (CNNs) have shown state-of-the-art performances in various computer vision tasks. Advances on CNN architectures have focused mainly on designing convolutional blocks of the feature extractors, but less on the classifiers that exploit extracted features. In this work, we propose Split-and-Share Module (SSM),a classifier that splits a given feature into parts, which are partially shared by multiple sub-classifiers. Our intuition is that the more the features are shared, the more common they will become, and SSM can encourage such structural characteristics in the split features. SSM can be easily integrated into any architecture without bells and whistles. We have extensively validated the efficacy of SSM on ImageNet-1K classification task, andSSM has shown consistent and significant improvements over baseline architectures. In addition, we analyze the effect of SSM using the Grad-CAM visualization.

READ FULL TEXT

page 3

page 8

research
10/15/2020

HS-ResNet: Hierarchical-Split Block on Convolutional Neural Network

This paper addresses representational block named Hierarchical-Split Blo...
research
09/05/2013

Improvements to deep convolutional neural networks for LVCSR

Deep Convolutional Neural Networks (CNNs) are more powerful than Deep Ne...
research
01/01/2023

GoogLe2Net: Going Transverse with Convolutions

Capturing feature information effectively is of great importance in visi...
research
06/21/2020

Sequential Feature Filtering Classifier

We propose Sequential Feature Filtering Classifier (FFC), a simple but e...
research
01/29/2015

On Vectorization of Deep Convolutional Neural Networks for Vision Tasks

We recently have witnessed many ground-breaking results in machine learn...
research
01/20/2013

Cellular Tree Classifiers

The cellular tree classifier model addresses a fundamental problem in th...
research
03/05/2023

DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network

The rapid advances in Vision Transformer (ViT) refresh the state-of-the-...

Please sign up or login with your details

Forgot password? Click here to reset