Enhancing Evolutionary Optimization in Uncertain Environments by Allocating Evaluations via Multi-armed Bandit Algorithms

03/10/2018
by   Xin Qiu, et al.
0

Optimization problems with uncertain fitness functions are common in the real world, and present unique challenges for evolutionary optimization approaches. Existing issues include excessively expensive evaluation, lack of solution reliability, and incapability in maintaining high overall fitness during optimization. Using conversion rate optimization as an example, this paper proposes a series of new techniques for addressing these issues. The main innovation is to augment evolutionary algorithms by allocating evaluation budget through multi-armed bandit algorithms. Experimental results demonstrate that multi-armed bandit algorithms can be used to allocate evaluations efficiently, select the winning solution reliably and increase overall fitness during exploration. The proposed methods can be generalized to any optimization problems with noisy fitness functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/07/2022

PAC-Bayesian Lifelong Learning For Multi-Armed Bandits

We present a PAC-Bayesian analysis of lifelong learning. In the lifelong...
research
07/15/2014

Uncertainty And Evolutionary Optimization: A Novel Approach

Evolutionary algorithms (EA) have been widely accepted as efficient solv...
research
02/15/2022

End-to-end Automatic Logic Optimization Exploration via Domain-specific Multi-armed Bandit

Recent years have seen increasing employment of decision intelligence in...
research
07/19/2012

The Road to VEGAS: Guiding the Search over Neutral Networks

VEGAS (Varying Evolvability-Guided Adaptive Search) is a new methodology...
research
06/20/2016

Bandit-Based Random Mutation Hill-Climbing

The Random Mutation Hill-Climbing algorithm is a direct search technique...
research
03/09/2013

Expensive Optimisation: A Metaheuristics Perspective

Stochastic, iterative search methods such as Evolutionary Algorithms (EA...
research
11/27/2021

TPOT-SH: a Faster Optimization Algorithm to Solve the AutoML Problem on Large Datasets

Data are omnipresent nowadays and contain knowl- edge and patterns that...

Please sign up or login with your details

Forgot password? Click here to reset