A concatenating framework of shortcut convolutional neural networks

10/03/2017
by   Yujian Li, et al.
0

It is well accepted that convolutional neural networks play an important role in learning excellent features for image classification and recognition. However, in tradition they only allow adjacent layers connected, limiting integration of multi-scale information. To further improve their performance, we present a concatenating framework of shortcut convolutional neural networks. This framework can concatenate multi-scale features by shortcut connections to the fully-connected layer that is directly fed to the output layer. We do a large number of experiments to investigate performance of the shortcut convolutional neural networks on many benchmark visual datasets for different tasks. The datasets include AR, FERET, FaceScrub, CelebA for gender classification, CUReT for texture classification, MNIST for digit recognition, and CIFAR-10 for object recognition. Experimental results show that the shortcut convolutional neural networks can achieve better results than the traditional ones on these tasks, with more stability in different settings of pooling schemes, activation functions, optimizations, initializations, kernel numbers and kernel sizes.

READ FULL TEXT

page 7

page 10

research
02/20/2023

Kernel function impact on convolutional neural networks

This paper investigates the usage of kernel functions at the different l...
research
10/29/2019

Best Practices for Convolutional Neural Networks Applied to Object Recognition in Images

This research project studies the impact of convolutional neural network...
research
09/13/2015

On Binary Classification with Single-Layer Convolutional Neural Networks

Convolutional neural networks are becoming standard tools for solving ob...
research
07/07/2012

Object Recognition with Multi-Scale Pyramidal Pooling Networks

We present a Multi-Scale Pyramidal Pooling Network, featuring a novel py...
research
03/03/2017

Deep Collaborative Learning for Visual Recognition

Deep neural networks are playing an important role in state-of-the-art v...
research
01/06/2022

Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networks

Classification of long sequential data is an important Machine Learning ...
research
04/18/2012

Convolutional Neural Networks Applied to House Numbers Digit Classification

We classify digits of real-world house numbers using convolutional neura...

Please sign up or login with your details

Forgot password? Click here to reset