Parameters Optimization of Deep Learning Models using Particle Swarm Optimization

11/28/2017
by   Basheer Qolomany, et al.
0

Deep learning has been successfully applied in several fields such as machine translation, manufacturing, and pattern recognition. However, successful application of deep learning depends upon appropriately setting its parameters to achieve high quality results. The number of hidden layers and the number of neurons in each layer of a deep machine learning network are two key parameters, which have main influence on the performance of the algorithm. Manual parameter setting and grid search approaches somewhat ease the users tasks in setting these important parameters. Nonetheless, these two techniques can be very time consuming. In this paper, we show that the Particle swarm optimization (PSO) technique holds great potential to optimize parameter settings and thus saves valuable computational resources during the tuning process of deep learning models. Specifically, we use a dataset collected from a Wi-Fi campus network to train deep learning models to predict the number of occupants and their locations. Our preliminary experiments indicate that PSO provides an efficient approach for tuning the optimal number of hidden layers and the number of neurons in each layer of the deep learning algorithm when compared to the grid search method. Our experiments illustrate that the exploration process of the landscape of configurations to find the optimal parameters is decreased by 77 accuracy results.

READ FULL TEXT
research
09/05/2020

Particle Swarm Optimized Federated Learning For Industrial IoT and Smart City Services

Most of the research on Federated Learning (FL) has focused on analyzing...
research
10/11/2022

Dataloader Parameter Tuner: An Automated Dataloader Parameter Tuner for Deep Learning Models

Deep learning has recently become one of the most compute/data-intensive...
research
03/08/2021

SCNN: Swarm Characteristic Neural Network

Deep learning is a powerful approach with good performance on many diffe...
research
07/30/2019

Ablate, Variate, and Contemplate: Visual Analytics for Discovering Neural Architectures

Deep learning models require the configuration of many layers and parame...
research
04/25/2023

Deep Learning Framework for the Design of Orbital Angular Momentum Generators Enabled by Leaky-wave Holograms

In this paper, we present a novel approach for the design of leaky-wave ...
research
10/16/2019

Machine Learning based parameter tuning strategy for MMC based topology optimization

Moving Morphable Component (MMC) based topology optimization approach is...

Please sign up or login with your details

Forgot password? Click here to reset