An Exploration of Exploration: Measuring the ability of lexicase selection to find obscure pathways to optimality

Parent selection algorithms (selection schemes) steer populations through a problem's search space, often trading off between exploitation and exploration. Understanding how selection schemes affect exploitation and exploration within a search space is crucial to tackling increasingly challenging problems. Here, we introduce an "exploration diagnostic" that diagnoses a selection scheme's capacity for search space exploration. We use our exploration diagnostic to investigate the exploratory capacity of lexicase selection and several of its variants: epsilon lexicase, down-sampled lexicase, cohort lexicase, and novelty-lexicase. We verify that lexicase selection out-explores tournament selection, and we show that lexicase selection's exploratory capacity can be sensitive to the ratio between population size and the number of test cases used for evaluating candidate solutions. Additionally, we find that relaxing lexicase's elitism with epsilon lexicase can further improve exploration. Both down-sampling and cohort lexicase – two techniques for applying random subsampling to test cases – degrade lexicase's exploratory capacity; however, we find that cohort partitioning better preserves lexicase's exploratory capacity than down-sampling. Finally, we find evidence that novelty-lexicase's addition of novelty test cases can degrade lexicase's capacity for exploration. Overall, our findings provide hypotheses for further exploration and actionable insights and recommendations for using lexicase selection. Additionally, this work demonstrates the value of selection scheme diagnostics as a complement to more conventional benchmarking approaches to selection scheme analysis.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2022

A suite of diagnostic metrics for characterizing selection schemes

Evolutionary algorithms are effective general-purpose techniques for sol...
research
05/22/2019

Comparing and Combining Lexicase Selection and Novelty Search

Lexicase selection and novelty search, two parent selection methods used...
research
03/22/2021

Transforming Exploratory Creativity with DeLeNoX

We introduce DeLeNoX (Deep Learning Novelty Explorer), a system that aut...
research
02/05/2021

Sparse Reward Exploration via Novelty Search and Emitters

Reward-based optimization algorithms require both exploration, to find r...
research
07/21/2011

Centric selection: a way to tune the exploration/exploitation trade-off

In this paper, we study the exploration / exploitation trade-off in cell...
research
05/06/2022

Geodesics, Non-linearities and the Archive of Novelty Search

The Novelty Search (NS) algorithm was proposed more than a decade ago. H...
research
04/18/2019

Batch Tournament Selection for Genetic Programming

Lexicase selection achieves very good solution quality by introducing or...

Please sign up or login with your details

Forgot password? Click here to reset