An Architecture Combining Convolutional Neural Network (CNN) and Support Vector Machine (SVM) for Image Classification

12/10/2017
by   Abien Fred Agarap, et al.
0

Convolutional neural networks (CNNs) are similar to "ordinary" neural networks in the sense that they are made up of hidden layers consisting of neurons with "learnable" parameters. These neurons receive inputs, performs a dot product, and then follows it with a non-linearity. The whole network expresses the mapping between raw image pixels and their class scores. Conventionally, the Softmax function is the classifier used at the last layer of this network. However, there have been studies (Alalshekmubarak and Smith, 2013; Agarap, 2017; Tang, 2013) conducted to challenge this norm. The cited studies introduce the usage of linear support vector machine (SVM) in an artificial neural network architecture. This project is yet another take on the subject, and is inspired by (Tang, 2013). Empirical data has shown that the CNN-SVM model was able to achieve a test accuracy of 99.04 dataset (LeCun, Cortes, and Burges, 2010). On the other hand, the CNN-Softmax was able to achieve a test accuracy of 99.23 models were also tested on the recently-published Fashion-MNIST dataset (Xiao, Rasul, and Vollgraf, 2017), which is suppose to be a more difficult image classification dataset than MNIST (Zalandoresearch, 2017). This proved to be the case as CNN-SVM reached a test accuracy of 90.72 reached a test accuracy of 91.86 preprocessing techniques were employed on the datasets, and if the base CNN model was a relatively more sophisticated than the one used in this study.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2019

Comparing pattern sensitivity of a convolutional neural network with an ideal observer and support vector machine

We investigate the performance of a convolutional neural network (CNN) a...
research
12/20/2019

Analysis of Video Feature Learning in Two-Stream CNNs on the Example of Zebrafish Swim Bout Classification

Semmelhack et al. (2014) have achieved high classification accuracy in d...
research
09/12/2023

Using Unsupervised and Supervised Learning and Digital Twin for Deep Convective Ice Storm Classification

Smart Ice Cloud Sensing (SMICES) is a small-sat concept in which a prima...
research
06/02/2015

Classify Images with Conceptor Network

This article demonstrates a new conceptor network based classifier in cl...
research
10/12/2020

A Neurochaos Learning Architecture for Genome Classification

There has been empirical evidence of presence of non-linearity and chaos...
research
10/01/2020

An Ultra Lightweight CNN for Low Resource Circuit Component Recognition

In this paper, we present an ultra lightweight system that can effective...

Please sign up or login with your details

Forgot password? Click here to reset