Analysing Symbolic Regression Benchmarks under a Meta-Learning Approach

The definition of a concise and effective testbed for Genetic Programming (GP) is a recurrent matter in the research community. This paper takes a new step in this direction, proposing a different approach to measure the quality of the symbolic regression benchmarks quantitatively. The proposed approach is based on meta-learning and uses a set of dataset meta-features---such as the number of examples or output skewness---to describe the datasets. Our idea is to correlate these meta-features with the errors obtained by a GP method. These meta-features define a space of benchmarks that should, ideally, have datasets (points) covering different regions of the space. An initial analysis of 63 datasets showed that current benchmarks are concentrated in a small region of this benchmark space. We also found out that number of instances and output skewness are the most relevant meta-features to GP output error. Both conclusions can help define which datasets should compose an effective testbed for symbolic regression methods.

READ FULL TEXT

page 5

page 8

research
07/07/2015

Developing Postfix-GP Framework for Symbolic Regression Problems

This paper describes Postfix-GP system, postfix notation based Genetic P...
research
07/25/2019

Towards meta-learning for multi-target regression problems

Several multi-target regression methods were devel-oped in the last year...
research
09/14/2019

Torchmeta: A Meta-Learning library for PyTorch

The constant introduction of standardized benchmarks in the literature h...
research
09/02/2022

Local Optimization Often is Ill-conditioned in Genetic Programming for Symbolic Regression

Gradient-based local optimization has been shown to improve results of g...
research
07/15/2021

Principal component analysis for Gaussian process posteriors

This paper proposes an extension of principal component analysis for Gau...
research
07/24/2018

Meta-Learning Priors for Efficient Online Bayesian Regression

Gaussian Process (GP) regression has seen widespread use in robotics due...
research
05/22/2019

A Neural-Symbolic Architecture for Inverse Graphics Improved by Lifelong Meta-Learning

We follow the idea of formulating vision as inverse graphics and propose...

Please sign up or login with your details

Forgot password? Click here to reset