Examining the Use of Neural Networks for Feature Extraction: A Comparative Analysis using Deep Learning, Support Vector Machines, and K-Nearest Neighbor Classifiers

05/06/2018
by   Stephen Notley, et al.
0

Neural networks in many varieties are touted as very powerful machine learning tools because of their ability to distill large amounts of information from different forms of data, extracting complex features and enabling powerful classification abilities. In this study, we use neural networks to extract features from both images and numeric data and use these extracted features as inputs for other machine learning models, namely support vector machines (SVMs) and k-nearest neighbor classifiers (KNNs), in order to see if neural-network-extracted features enhance the capabilities of these models. We tested 7 different neural network architectures in this manner, 4 for images and 3 for numeric data, training each for varying lengths of time and then comparing the results of the neural network independently to those of an SVM and KNN on the data, and finally comparing these results to models of SVM and KNN trained using features extracted via the neural network architecture. This process was repeated on 3 different image datasets and 2 different numeric datasets. The results show that, in many cases, the features extracted using the neural network significantly improve the capabilities of SVMs and KNNs compared to running these algorithms on the raw features, and in some cases also surpass the performance of the neural network alone. This in turn suggests that it may be a reasonable practice to use neural networks as a means to extract features for classification by other machine learning models for some datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2021

Drone Detection Using Convolutional Neural Networks

In image processing, it is essential to detect and track air targets, es...
research
06/22/2018

Compact Deep Neural Networks for Computationally Efficient Gesture Classification From Electromyography Signals

Machine learning classifiers using surface electromyography are importan...
research
07/25/2021

Character Spotting Using Machine Learning Techniques

This work presents a comparison of machine learning algorithms that are ...
research
06/27/2018

hep-th

We apply techniques in natural language processing, computational lingui...
research
08/21/2017

Deep vs. Diverse Architectures for Classification Problems

This study compares various superlearner and deep learning architectures...
research
05/04/2016

Accelerating Deep Learning with Shrinkage and Recall

Deep Learning is a very powerful machine learning model. Deep Learning t...
research
05/16/2019

Vector Field Neural Networks

This work begins by establishing a mathematical formalization between di...

Please sign up or login with your details

Forgot password? Click here to reset