DeepAI AI Chat
Log In Sign Up

Single neuron-based neural networks are as efficient as dense deep neural networks in binary and multi-class recognition problems

by   Yassin Khalifa, et al.

Recent advances in neuroscience have revealed many principles about neural processing. In particular, many biological systems were found to reconfigure/recruit single neurons to generate multiple kinds of decisions. Such findings have the potential to advance our understanding of the design and optimization process of artificial neural networks. Previous work demonstrated that dense neural networks are needed to shape complex decision surfaces required for AI-level recognition tasks. We investigate the ability to model high dimensional recognition problems using single or several neurons networks that are relatively easier to train. By employing three datasets, we test the use of a population of single neuron networks in performing multi-class recognition tasks. Surprisingly, we find that sparse networks can be as efficient as dense networks in both binary and multi-class tasks. Moreover, single neuron networks demonstrate superior performance in binary classification scheme and competing results when combined for multi-class recognition.


page 1

page 3

page 4


Classification of optics-free images with deep neural networks

The thinnest possible camera is achieved by removing all optics, leaving...

Adversarial Multi-Binary Neural Network for Multi-class Classification

Multi-class text classification is one of the key problems in machine le...

Artificial Neural Networks for Finger Vein Recognition: A Survey

Finger vein recognition is an emerging biometric recognition technology....

Experiments on Open-Set Speaker Identification with Discriminatively Trained Neural Networks

This paper presents a study on discriminative artificial neural network ...

A two-dimensional multi-class traffic flow model

The aim of this work is to introduce a two-dimensional macroscopic traff...

Towards the Evolution of Multi-Layered Neural Networks: A Dynamic Structured Grammatical Evolution Approach

Current grammar-based NeuroEvolution approaches have several shortcoming...