Stochastic Optimization of Plain Convolutional Neural Networks with Simple methods

01/24/2020
by   Yahia Assiri, et al.
0

Convolutional neural networks have been achieving the best possible accuracies in many visual pattern classification problems. However, due to the model capacity required to capture such representations, they are often oversensitive to overfitting and therefore require proper regularization to generalize well. In this paper, we present a combination of regularization techniques which work together to get better performance, we built plain CNNs, and then we used data augmentation, dropout and customized early stopping function, we tested and evaluated these techniques by applying models on five famous datasets, MNIST, CIFAR10, CIFAR100, SVHN, STL10, and we achieved three state-of-the-art-of (MNIST, SVHN, STL10) and very high-Accuracy on the other two datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2013

Stochastic Pooling for Regularization of Deep Convolutional Neural Networks

We introduce a simple and effective method for regularizing large convol...
research
07/28/2022

Optimization of Artificial Neural Networks models applied to the identification of images of asteroids' resonant arguments

The asteroidal main belt is crossed by a web of mean-motion and secular ...
research
06/11/2018

Data augmentation instead of explicit regularization

Modern deep artificial neural networks have achieved impressive results ...
research
07/19/2019

Post-synaptic potential regularization has potential

Improving generalization is one of the main challenges for training deep...
research
09/13/2015

On Binary Classification with Single-Layer Convolutional Neural Networks

Convolutional neural networks are becoming standard tools for solving ob...
research
09/01/2019

Improved Image Augmentation for Convolutional Neural Networks by Copyout and CopyPairing

Image augmentation is a widely used technique to improve the performance...
research
11/07/2016

Regularizing CNNs with Locally Constrained Decorrelations

Regularization is key for deep learning since it allows training more co...

Please sign up or login with your details

Forgot password? Click here to reset