Analysing the Robustness of NSGA-II under Noise

06/07/2023
by   Duc-Cuong Dang, et al.
0

Runtime analysis has produced many results on the efficiency of simple evolutionary algorithms like the (1+1) EA, and its analogue called GSEMO in evolutionary multiobjective optimisation (EMO). Recently, the first runtime analyses of the famous and highly cited EMO algorithm NSGA-II have emerged, demonstrating that practical algorithms with thousands of applications can be rigorously analysed. However, these results only show that NSGA-II has the same performance guarantees as GSEMO and it is unclear how and when NSGA-II can outperform GSEMO. We study this question in noisy optimisation and consider a noise model that adds large amounts of posterior noise to all objectives with some constant probability p per evaluation. We show that GSEMO fails badly on every noisy fitness function as it tends to remove large parts of the population indiscriminately. In contrast, NSGA-II is able to handle the noise efficiently on LeadingOnesTrailingZeroes when p<1/2, as the algorithm is able to preserve useful search points even in the presence of noise. We identify a phase transition at p=1/2 where the expected time to cover the Pareto front changes from polynomial to exponential. To our knowledge, this is the first proof that NSGA-II can outperform GSEMO and the first runtime analysis of NSGA-II in noisy optimisation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2023

A Proof that Using Crossover Can Guarantee Exponential Speed-Ups in Evolutionary Multi-Objective Optimisation

Evolutionary algorithms are popular algorithms for multiobjective optimi...
research
12/03/2018

Analysing the Robustness of Evolutionary Algorithms to Noise: Refined Runtime Bounds and an Example Where Noise is Beneficial

We analyse the performance of well-known evolutionary algorithms (1+1)EA...
research
05/17/2023

Runtime Analyses of Multi-Objective Evolutionary Algorithms in the Presence of Noise

In single-objective optimization, it is well known that evolutionary alg...
research
09/04/2017

Theoretical Analysis of Stochastic Search Algorithms

Theoretical analyses of stochastic search algorithms, albeit few, have a...
research
02/10/2015

The Benefit of Sex in Noisy Evolutionary Search

The benefit of sexual recombination is one of the most fundamental quest...
research
04/15/2019

The Efficiency Threshold for the Offspring Population Size of the (μ, λ) EA

Understanding when evolutionary algorithms are efficient or not, and how...
research
03/26/2018

Runtime Analysis of Probabilistic Crowding and Restricted Tournament Selection for Bimodal Optimisation

Many real optimisation problems lead to multimodal domains and so requir...

Please sign up or login with your details

Forgot password? Click here to reset