A Note On The Popularity of Stochastic Optimization Algorithms in Different Fields: A Quantitative Analysis from 2007 to 2017

06/30/2019
by   Son Duy Dao, et al.
0

Stochastic optimization algorithms are often used to solve complex large-scale optimization problems in various fields. To date, there have been a number of stochastic optimization algorithms such as Genetic Algorithm, Cuckoo Search, Tabu Search, Simulated Annealing, Particle Swarm Optimization, Ant Colony Optimization, etc. Each algorithm has some advantages and disadvantages. Currently, there is no study that can help researchers to choose the most popular optimization algorithm to deal with the problems in different research fields. In this note, a quantitative analysis of the popularity of 14 stochastic optimization algorithms in 18 different research fields in the last ten years from 2007 to 2017 is provided. This quantitative analysis can help researchers/practitioners select the best optimization algorithm to solve complex large-scale optimization problems in the fields of Engineering, Computer science, Operations research, Mathematics, Physics, Chemistry, Automation control systems, Materials science, Energy fuels, Mechanics, Telecommunications, Thermodynamics, Optics, Environmental sciences ecology, Water resources, Transportation, Construction building technology, and Robotics.

READ FULL TEXT
research
10/27/2017

SGDLibrary: A MATLAB library for stochastic gradient descent algorithms

We consider the problem of finding the minimizer of a function f: R^d →R...
research
12/18/2017

Third-order Smoothness Helps: Even Faster Stochastic Optimization Algorithms for Finding Local Minima

We propose stochastic optimization algorithms that can find local minima...
research
06/26/2015

ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Stochastic optimization is an important task in many optimization proble...
research
03/01/2017

Learning to Optimize Neural Nets

Learning to Optimize is a recently proposed framework for learning optim...
research
09/26/2019

Randomized Iterative Methods for Linear Systems: Momentum, Inexactness and Gossip

In the era of big data, one of the key challenges is the development of ...
research
01/18/2021

Critical Analysis: Bat Algorithm based Investigation and Application on Several Domains

In recent years several swarm optimization algorithms, such as Bat Algor...
research
12/02/2012

Metaheuristic Optimization: Algorithm Analysis and Open Problems

Metaheuristic algorithms are becoming an important part of modern optimi...

Please sign up or login with your details

Forgot password? Click here to reset