CPWC: Contextual Point Wise Convolution for Object Recognition

10/21/2019
by   Pratik Mazumder, et al.
0

Convolutional layers are a major driving force behind the successes of deep learning. Pointwise convolution (PWC) is a 1x1 convolutional filter that is primarily used for parameter reduction. However, the PWC ignores the spatial information around the points it is processing. This design is by choice, in order to reduce the overall parameters and computations. However, we hypothesize that this shortcoming of PWC has a significant impact on the network performance. We propose an alternative design for pointwise convolution, which uses spatial information from the input efficiently. Our design significantly improves the performance of the networks without substantially increasing the number of parameters and computations. We experimentally show that our design results in significant improvement in the performance of the network for classification as well as detection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/15/2019

LeanResNet: A Low-cost yet Effective Convolutional Residual Networks

Convolutional Neural Networks (CNNs) filter the input data using a serie...
research
11/07/2020

Depthwise Multiception Convolution for Reducing Network Parameters without Sacrificing Accuracy

Deep convolutional neural networks have been proven successful in multip...
research
03/22/2016

Convolution in Convolution for Network in Network

Network in Netwrok (NiN) is an effective instance and an important exten...
research
08/15/2016

Design of Efficient Convolutional Layers using Single Intra-channel Convolution, Topological Subdivisioning and Spatial "Bottleneck" Structure

Deep convolutional neural networks achieve remarkable visual recognition...
research
05/29/2019

Attention Based Pruning for Shift Networks

In many application domains such as computer vision, Convolutional Layer...
research
07/13/2021

The Foes of Neural Network's Data Efficiency Among Unnecessary Input Dimensions

Datasets often contain input dimensions that are unnecessary to predict ...
research
02/05/2020

Analyzing the Dependency of ConvNets on Spatial Information

Intuitively, image classification should profit from using spatial infor...

Please sign up or login with your details

Forgot password? Click here to reset