Accelerating Genetic Programming using GPUs

10/15/2021
by   Vimarsh Sathia, et al.
0

Genetic Programming (GP), an evolutionary learning technique, has multiple applications in machine learning such as curve fitting, data modelling, feature selection, classification etc. GP has several inherent parallel steps, making it an ideal candidate for GPU based parallelization. This paper describes a GPU accelerated stack-based variant of the generational GP algorithm which can be used for symbolic regression and binary classification. The selection and evaluation steps of the generational GP algorithm are parallelized using CUDA. We introduce representing candidate solution expressions as prefix lists, which enables evaluation using a fixed-length stack in GPU memory. CUDA based matrix vector operations are also used for computation of the fitness of population programs. We evaluate our algorithm on synthetic datasets for the Pagie Polynomial (ranging in size from 4096 to 16 million points), profiling training times of our algorithm with other standard symbolic regression libraries viz. gplearn, TensorGP and KarooGP. In addition, using 6 large-scale regression and classification datasets usually used for comparing gradient boosting algorithms, we run performance benchmarks on our algorithm and gplearn, profiling the training time, test accuracy, and loss. On an NVIDIA DGX-A100 GPU, our algorithm outperforms all the previously listed frameworks, and in particular, achieves average speedups of 119× and 40× against gplearn on the synthetic and large scale datasets respectively.

READ FULL TEXT
research
07/07/2015

Developing Postfix-GP Framework for Symbolic Regression Problems

This paper describes Postfix-GP system, postfix notation based Genetic P...
research
08/24/2021

On the Effectiveness of Genetic Operations in Symbolic Regression

This paper describes a methodology for analyzing the evolutionary dynami...
research
04/28/2022

Taylor Genetic Programming for Symbolic Regression

Genetic programming (GP) is a commonly used approach to solve symbolic r...
research
03/03/2014

Global solar irradiation prediction using a multi-gene genetic programming approach

In this paper, a nonlinear symbolic regression technique using an evolut...
research
05/19/2020

Out-of-Core GPU Gradient Boosting

GPU-based algorithms have greatly accelerated many machine learning meth...
research
05/21/2017

Parallel and in-process compilation of individuals for genetic programming on GPU

Three approaches to implement genetic programming on GPU hardware are co...
research
12/07/2020

Estimation of Gas Turbine Shaft Torque and Fuel Flow of a CODLAG Propulsion System Using Genetic Programming Algorithm

In this paper, the publicly available dataset of condition based mainten...

Please sign up or login with your details

Forgot password? Click here to reset