MAC, a novel stochastic optimization method

04/14/2023
by   Attila László Nagy, et al.
0

A novel stochastic optimization method called MAC was suggested. The method is based on the calculation of the objective function at several random points and then an empirical expected value and an empirical covariance matrix are calculated. The empirical expected value is proven to converge to the optimum value of the problem. The MAC algorithm was encoded in Matlab and the code was tested on 20 test problems. Its performance was compared with those of the interior point method (Matlab name: fmincon), simplex, pattern search (PS), simulated annealing (SA), particle swarm optimization (PSO), and genetic algorithm (GA) methods. The MAC method failed two test functions and provided inaccurate results on four other test functions. However, it provided accurate results and required much less CPU time than the widely used optimization methods on the other 14 test functions.

READ FULL TEXT
research
05/29/2020

CoolMomentum: A Method for Stochastic Optimization by Langevin Dynamics with Simulated Annealing

Deep learning applications require optimization of nonconvex objective f...
research
10/15/2011

Fuzzy Inference Systems Optimization

This paper compares various optimization methods for fuzzy inference sys...
research
09/09/2018

LDW-SCSA: Logistic Dynamic Weight based Sine Cosine Search Algorithm for Numerical Functions Optimization

Particle swarm optimization (PSO) and Sine Cosine algorithm (SCA) have b...
research
09/02/2021

Application of Monte Carlo Stochastic Optimization (MOST) to Deep Learning

In this paper, we apply the Monte Carlo stochastic optimization (MOST) p...
research
12/10/2017

Comparative analysis of criteria for filtering time series of word usage frequencies

This paper describes a method of nonlinear wavelet thresholding of time ...
research
11/30/2019

Data-Driven Optimization of Public Transit Schedule

Bus transit systems are the backbone of public transportation in the Uni...

Please sign up or login with your details

Forgot password? Click here to reset