Informed Down-Sampled Lexicase Selection: Identifying productive training cases for efficient problem solving

01/04/2023
by   Ryan Boldi, et al.
0

Genetic Programming (GP) often uses large training sets and requires all individuals to be evaluated on all training cases during selection. Random down-sampled lexicase selection evaluates individuals on only a random subset of the training cases allowing for more individuals to be explored with the same amount of program executions. However, creating a down-sample randomly might exclude important cases from the current down-sample for a number of generations, while cases that measure the same behavior (synonymous cases) may be overused despite their redundancy. In this work, we introduce Informed Down-Sampled Lexicase Selection. This method leverages population statistics to build down-samples that contain more distinct and therefore informative training cases. Through an empirical investigation across two different GP systems (PushGP and Grammar-Guided GP), we find that informed down-sampling significantly outperforms random down-sampling on a set of contemporary program synthesis benchmark problems. Through an analysis of the created down-samples, we find that important training cases are included in the down-sample consistently across independent evolutionary runs and systems. We hypothesize that this improvement can be attributed to the ability of Informed Down-Sampled Lexicase Selection to maintain more specialist individuals over the course of evolution, while also benefiting from reduced per-evaluation costs.

READ FULL TEXT

page 18

page 19

page 20

page 21

research
04/14/2023

Analyzing the Interaction Between Down-Sampling and Selection

Genetic programming systems often use large training sets to evaluate th...
research
05/31/2022

The Environmental Discontinuity Hypothesis for Down-Sampled Lexicase Selection

Down-sampling training data has long been shown to improve the generaliz...
research
06/10/2021

Problem-solving benefits of down-sampled lexicase selection

In genetic programming, an evolutionary method for producing computer pr...
research
04/04/2023

A Static Analysis of Informed Down-Samples

We present an analysis of the loss of population-level test coverage ind...
research
06/29/2020

Applying Dynamic Training-Subset Selection Methods Using Genetic Programming for Forecasting Implied Volatility

Volatility is a key variable in option pricing, trading and hedging stra...
research
05/22/2019

Lexicase Selection of Specialists

Lexicase parent selection filters the population by considering one rand...
research
09/15/2017

ε-Lexicase selection: a probabilistic and multi-objective analysis of lexicase selection in continuous domains

Lexicase selection is a parent selection method that considers training ...

Please sign up or login with your details

Forgot password? Click here to reset