An Efficient Transfer Learning Technique by Using Final Fully-Connected Layer Output Features of Deep Networks

11/19/2018
by   Tasfia Shermin, et al.
0

In this paper, we propose a computationally efficient transfer learning approach using the output vector of final fully-connected layer of deep convolutional neural networks for classification. Our proposed technique uses a single layer perceptron classifier designed with hyper-parameters to focus on improving computational efficiency without adversely affecting the performance of classification compared to the baseline technique. Our investigations show that our technique converges much faster than baseline yielding very competitive classification results. We execute thorough experiments to understand the impact of similarity between pre-trained and new classes, similarity among new classes, number of training samples in the performance of classification using transfer learning of the final fully-connected layer's output features.

READ FULL TEXT

page 3

page 5

page 7

research
04/28/2020

Do We Need Fully Connected Output Layers in Convolutional Networks?

Traditionally, deep convolutional neural networks consist of a series of...
research
05/22/2017

An Out-of-the-box Full-network Embedding for Convolutional Neural Networks

Transfer learning for feature extraction can be used to exploit deep rep...
research
04/28/2015

Speeding Up Neural Networks for Large Scale Classification using WTA Hashing

In this paper we propose to use the Winner Takes All hashing technique t...
research
02/08/2022

EvoPruneDeepTL: An Evolutionary Pruning Model for Transfer Learning based Deep Neural Networks

In recent years, Deep Learning models have shown a great performance in ...
research
06/20/2019

Clustering and Classification Networks

In this paper, we will describe a network architecture that demonstrates...
research
05/24/2022

An interpretation of the final fully connected layer

In recent years neural networks have achieved state-of-the-art accuracy ...

Please sign up or login with your details

Forgot password? Click here to reset