Hyper-parameter estimation method with particle swarm optimization

11/24/2020
by   Yaru Li, et al.
0

Particle swarm optimization (PSO) method cannot be directly used in the problem of hyper-parameter estimation since the mathematical formulation of the mapping from hyper-parameters to loss function or generalization accuracy is unclear. Bayesian optimization (BO) framework is capable of converting the optimization of the hyper-parameters into the optimization of an acquisition function. The acquisition function is non-convex and multi-peak. So the problem can be better solved by the PSO. The proposed method in this paper uses the particle swarm method to optimize the acquisition function in the BO framework to get better hyper-parameters. The performances of proposed method in both of the classification and regression models are evaluated and demonstrated. The results on several benchmark problems are improved.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

06/15/2020

A Particle Swarm Optimization hyper-heuristic for the Dynamic Vehicle Routing Problem

This paper presents a method for choosing a Particle Swarm Optimization ...
05/26/2019

Particle swarm optimization model to predict scour depth around bridge pier

Scour depth around bridge piers plays a vital role in the safety and sta...
05/22/2018

A Parameter Estimation of Fractional Order Gray Model Based on Adaptive Dynamic Cat Swarm Algorithm

In this paper, we utilize ADCSO (Adaptive Dynamic Cat Swarm Optimization...
05/22/2018

A Parameter Estimation of Fractional Order Grey Model Based on Adaptive Dynamic Cat Swarm Algorithm

In this paper, we utilize ADCSO (Adaptive Dynamic Cat Swarm Optimization...
03/08/2020

A Comparative Study on Parameter Estimation in Software Reliability Modeling using Swarm Intelligence

This work focuses on a comparison between the performances of two well-k...
04/10/2021

A Swarm Variant for the Schrödinger Solver

This paper introduces application of the Exponentially Averaged Momentum...
06/12/2019

A K-means-based Multi-subpopulation Particle Swarm Optimization for Neural Network Ensemble

This paper presents a k-means-based multi-subpopulation particle swarm o...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.