Learning Structure and Strength of CNN Filters for Small Sample Size Training

03/30/2018
by   Rohit Keshari, et al.
0

Convolutional Neural Networks have provided state-of-the-art results in several computer vision problems. However, due to a large number of parameters in CNNs, they require a large number of training samples which is a limiting factor for small sample size problems. To address this limitation, we propose SSF-CNN which focuses on learning the structure and strength of filters. The structure of the filter is initialized using a dictionary-based filter learning algorithm and the strength of the filter is learned using the small sample training data. The architecture provides the flexibility of training with both small and large training databases and yields good accuracies even with small size training data. The effectiveness of the algorithm is first demonstrated on MNIST, CIFAR10, and NORB databases, with a varying number of training samples. The results show that SSF-CNN significantly reduces the number of parameters required for training while providing high accuracies the test databases. On small sample size problems such as newborn face recognition and Omniglot, it yields state-of-the-art results. Specifically, on the IIITD Newborn Face Database, the results demonstrate improvement in rank-1 identification accuracy by at least 10

READ FULL TEXT

page 1

page 3

page 4

page 7

research
08/08/2020

Unravelling Small Sample Size Problems in the Deep Learning World

The growth and success of deep learning approaches can be attributed to ...
research
02/21/2019

Convolutional Analysis Operator Learning: Dependence on Training Data

Convolutional analysis operator learning (CAOL) enables the unsupervised...
research
03/11/2015

A Novel Hybrid CNN-AIS Visual Pattern Recognition Engine

Machine learning methods are used today for most recognition problems. C...
research
12/08/2016

Filter sharing: Efficient learning of parameters for volumetric convolutions

Typical convolutional neural networks (CNNs) have several millions of pa...
research
04/04/2018

Boosting Handwriting Text Recognition in Small Databases with Transfer Learning

In this paper we deal with the offline handwriting text recognition (HTR...
research
04/30/2019

Harmonic Networks with Limited Training Samples

Convolutional neural networks (CNNs) are very popular nowadays for image...
research
12/29/2020

Analysis of the Scalability of a Deep-Learning Network for Steganography "Into the Wild"

Since the emergence of deep learning and its adoption in steganalysis fi...

Please sign up or login with your details

Forgot password? Click here to reset