LEA: Beyond Evolutionary Algorithms via Learned Optimization Strategy

04/19/2023
by   Kai Wu, et al.
0

Evolutionary algorithms (EAs) have emerged as a powerful framework for expensive black-box optimization. Obtaining better solutions with less computational cost is essential and challenging for black-box optimization. The most critical obstacle is figuring out how to effectively use the target task information to form an efficient optimization strategy. However, current methods are weak due to the poor representation of the optimization strategy and the inefficient interaction between the optimization strategy and the target task. To overcome the above limitations, we design a learned EA (LEA) to realize the move from hand-designed optimization strategies to learned optimization strategies, including not only hyperparameters but also update rules. Unlike traditional EAs, LEA has high adaptability to the target task and can obtain better solutions with less computational cost. LEA is also able to effectively utilize the low-fidelity information of the target task to form an efficient optimization strategy. The experimental results on one synthetic case, CEC 2013, and two real-world cases show the advantages of learned optimization strategies over human-designed baselines. In addition, LEA is friendly to the acceleration provided by Graphics Processing Units and runs 102 times faster than unaccelerated EA when evolving 32 populations, each containing 6400 individuals.

READ FULL TEXT

page 8

page 11

page 12

page 15

research
04/24/2023

B2Opt: Learning to Optimize Black-box Optimization with Little Budget

Learning to optimize (L2O) has emerged as a powerful framework for black...
research
05/06/2022

Generative Evolutionary Strategy For Black-Box Optimizations

Many scientific and technological problems are related to optimization. ...
research
04/29/2020

Versatile Black-Box Optimization

Choosing automatically the right algorithm using problem descriptors is ...
research
06/17/2021

Optimum-statistical collaboration towards efficient black-box optimization

With increasingly more hyperparameters involved in their training, machi...
research
11/13/2020

Finding optimal Pulse Repetion Intervals with Many-objective Evolutionary Algorithms

In this paper we consider the problem of finding Pulse Repetition Interv...
research
06/05/2020

Population-Based Black-Box Optimization for Biological Sequence Design

The use of black-box optimization for the design of new biological seque...
research
11/09/2011

Scaling Up Estimation of Distribution Algorithms For Continuous Optimization

Since Estimation of Distribution Algorithms (EDA) were proposed, many at...

Please sign up or login with your details

Forgot password? Click here to reset