ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

06/26/2015
by   Jayanta Basak, et al.
0

Stochastic optimization is an important task in many optimization problems where the tasks are not expressible as convex optimization problems. In the case of non-convex optimization problems, various different stochastic algorithms like simulated annealing, evolutionary algorithms, and tabu search are available. Most of these algorithms require user-defined parameters specific to the problem in order to find out the optimal solution. Moreover, in many situations, iterative fine-tunings are required for the user-defined parameters, and therefore these algorithms cannot adapt if the search space and the optima changes over time. In this paper we propose an adaptive parameter-free stochastic optimization technique for continuous random variables called ASOC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2017

Dynamic Stochastic Approximation for Multi-stage Stochastic Optimization

In this paper, we consider multi-stage stochastic optimization problems ...
research
03/21/2017

Deep Learning for Explicitly Modeling Optimization Landscapes

In all but the most trivial optimization problems, the structure of the ...
research
04/20/2015

Negatively Correlated Search

Evolutionary Algorithms (EAs) have been shown to be powerful tools for c...
research
06/30/2019

A Note On The Popularity of Stochastic Optimization Algorithms in Different Fields: A Quantitative Analysis from 2007 to 2017

Stochastic optimization algorithms are often used to solve complex large...
research
11/11/2020

Non-local Optimization: Imposing Structure on Optimization Problems by Relaxation

In stochastic optimization, particularly in evolutionary computation and...
research
09/26/2002

Extremal Optimization: an Evolutionary Local-Search Algorithm

A recently introduced general-purpose heuristic for finding high-quality...
research
05/26/2022

Predictor-corrector algorithms for stochastic optimization under gradual distribution shift

Time-varying stochastic optimization problems frequently arise in machin...

Please sign up or login with your details

Forgot password? Click here to reset