SCNN: Swarm Characteristic Neural Network

03/08/2021
by   Ha-Thanh Nguyen, et al.
0

Deep learning is a powerful approach with good performance on many different tasks. However, these models often require massive computational resources. It is a worrying trend that we increasingly need models that work well on more complex problems. In this paper, we propose and verify the effectiveness and efficiency of SCNN, an innovative neural network inspired by the swarm concept. In addition to introducing the relevant theories, our detailed experiments suggest that fewer parameters may perform better than models with more parameters. Besides, our experiments show that SCNN needs less data than traditional models. That could be an essential hint for problems where there is not much data.

READ FULL TEXT
research
11/28/2017

Parameters Optimization of Deep Learning Models using Particle Swarm Optimization

Deep learning has been successfully applied in several fields such as ma...
research
06/02/2022

Reinforcement learning based parameters adaption method for particle swarm optimization

Particle swarm optimization (PSO) is a well-known optimization algorithm...
research
11/08/2018

Unveiling Swarm Intelligence with Network Science-the Metaphor Explained

Self-organization is a natural phenomenon that emerges in systems with a...
research
03/04/2019

Deep Learning for Cognitive Neuroscience

Neural network models can now recognise images, understand text, transla...
research
01/27/2023

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

Many deep learning applications benefit from using large models with bil...
research
10/24/2012

Towards Swarm Calculus: Urn Models of Collective Decisions and Universal Properties of Swarm Performance

Methods of general applicability are searched for in swarm intelligence ...
research
03/06/2022

Discovering the Characteristic Set of Metaheuristic Algorithm to Adapt with ANFIS Model

In recent years, many applications based on the neural network, neuro fu...

Please sign up or login with your details

Forgot password? Click here to reset