Network In Network

by   Min Lin, et al.

We propose a novel deep network structure called "Network In Network" (NIN) to enhance model discriminability for local patches within the receptive field. The conventional convolutional layer uses linear filters followed by a nonlinear activation function to scan the input. Instead, we build micro neural networks with more complex structures to abstract the data within the receptive field. We instantiate the micro neural network with a multilayer perceptron, which is a potent function approximator. The feature maps are obtained by sliding the micro networks over the input in a similar manner as CNN; they are then fed into the next layer. Deep NIN can be implemented by stacking mutiple of the above described structure. With enhanced local modeling via the micro network, we are able to utilize global average pooling over feature maps in the classification layer, which is easier to interpret and less prone to overfitting than traditional fully connected layers. We demonstrated the state-of-the-art classification performances with NIN on CIFAR-10 and CIFAR-100, and reasonable performances on SVHN and MNIST datasets.



There are no comments yet.


page 9


Efficient Quantum Feature Extraction for CNN-based Learning

Recent work has begun to explore the potential of parametrized quantum c...

Batch-normalized Maxout Network in Network

This paper reports a novel deep architecture referred to as Maxout netwo...

Pooling Methods in Deep Neural Networks, a Review

Nowadays, Deep Neural Networks are among the main tools used in various ...

Ensemble learning in CNN augmented with fully connected subnetworks

Convolutional Neural Networks (CNNs) have shown remarkable performance i...

N-fold Superposition: Improving Neural Networks by Reducing the Noise in Feature Maps

Considering the use of Fully Connected (FC) layer limits the performance...

Locally Smoothed Neural Networks

Convolutional Neural Networks (CNN) and the locally connected layer are ...

CUNet: A Compact Unsupervised Network for Image Classification

In this paper, we propose a compact network called CUNet (compact unsupe...

Code Repositories


Custom convolutional neural network on cifar-100 dataset for image classification. Images and their labels are processed to HDF5 data format for use in Caffe.

view repo


Implementation of Network In Network by chainer (Network In Network:

view repo


A keras implement of NIN

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.