Generative Evolutionary Strategy For Black-Box Optimizations

05/06/2022
by   Changhwi Park, et al.
0

Many scientific and technological problems are related to optimization. Among them, black-box optimization in high-dimensional space is particularly challenging. Recent neural network-based black-box optimization studies have shown noteworthy achievements. However, their capability in high-dimensional search space is still limited. This study investigates a novel black-box optimization method based on evolution strategy and generative neural network model. We designed the algorithm so that the evolutionary strategy and the generative neural network model work cooperatively with each other. This hybrid model enables reliable training of surrogate networks; it optimizes multi-objective, high-dimensional, and stochastic black-box functions. In this experiment, our method outperforms baseline optimization methods, including an NSGA-II and Bayesian optimization.

READ FULL TEXT
research
09/27/2019

Learning search spaces for Bayesian optimization: Another view of hyperparameter transfer learning

Bayesian optimization (BO) is a successful methodology to optimize black...
research
02/23/2018

Coloring black boxes: visualization of neural network decisions

Neural networks are commonly regarded as black boxes performing incompre...
research
02/11/2020

Differentiating the Black-Box: Optimization with Local Generative Surrogates

We propose a novel method for gradient-based optimization of black-box s...
research
01/31/2019

Improving Evolutionary Strategies with Generative Neural Networks

Evolutionary Strategies (ES) are a popular family of black-box zeroth-or...
research
10/11/2018

Multi-Strategy Coevolving Aging Particle Optimization

We propose Multi-Strategy Coevolving Aging Particles (MS-CAP), a novel p...
research
04/19/2023

LEA: Beyond Evolutionary Algorithms via Learned Optimization Strategy

Evolutionary algorithms (EAs) have emerged as a powerful framework for e...
research
11/06/2019

High-dimensional Black-box Optimization Under Uncertainty

Limited informative data remains the primary challenge for optimization ...

Please sign up or login with your details

Forgot password? Click here to reset