A comparison of evaluation methods in coevolution

05/21/2019
by   Ting-Shuo Yo, et al.
0

In this research, we compare four different evaluation methods in coevolution on the Majority Function problem. The size of the problem is selected such that evaluation against all possible test cases is feasible. Two measures are used for the comparisons, i.e., the objective fitness derived from evaluating solutions against all test cases, and the objective fitness correlation (OFC), which is defined as the correlation coefficient between subjective and objective fitness. The results of our experiments suggest that a combination of average score and weighted informativeness may provide a more accurate evaluation in coevolution. In order to confirm this difference, a series of t-tests on the preference between each pair of the evaluation methods is performed. The resulting significance is affirmative, and the tests for two quality measures show similar preference on four evaluation methods. study is the first time OFC is actually computed on a real problem. Experiments on Majority Function problems with larger sizes and Parity problems are in progress, and their results will be added in the final version.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/23/2014

Codynamic Fitness Landscapes of Coevolutionary Minimal Substrates

Coevolutionary minimal substrates are simple and abstract models that al...
research
01/16/2015

Coevolutionary intransitivity in games: A landscape analysis

Intransitivity is supposed to be a main reason for deficits in coevoluti...
research
06/05/2020

Optimising Tours for the Weighted Traveling Salesperson Problem and the Traveling Thief Problem: A Structural Comparison of Solutions

The Traveling Salesperson Problem (TSP) is one of the best-known combina...
research
02/23/2021

Automating Test Case Identification in Open Source Projects on GitHub

Software testing is one of the very important Quality Assurance (QA) com...
research
07/22/2022

Search-based Software Testing Driven by Automatically Generated and Manually Defined Fitness Functions

Search-based software testing (SBST) typically relies on fitness functio...
research
04/21/2022

Human Preferences as Dueling Bandits

The dramatic improvements in core information retrieval tasks engendered...
research
05/30/2019

Epsilon-Lexicase Selection for Regression

Lexicase selection is a parent selection method that considers test case...

Please sign up or login with your details

Forgot password? Click here to reset