DeepAI AI Chat
Log In Sign Up

Accelerating Genetic Programming using GPUs

by   Vimarsh Sathia, et al.
Indian Institute Of Technology, Madras

Genetic Programming (GP), an evolutionary learning technique, has multiple applications in machine learning such as curve fitting, data modelling, feature selection, classification etc. GP has several inherent parallel steps, making it an ideal candidate for GPU based parallelization. This paper describes a GPU accelerated stack-based variant of the generational GP algorithm which can be used for symbolic regression and binary classification. The selection and evaluation steps of the generational GP algorithm are parallelized using CUDA. We introduce representing candidate solution expressions as prefix lists, which enables evaluation using a fixed-length stack in GPU memory. CUDA based matrix vector operations are also used for computation of the fitness of population programs. We evaluate our algorithm on synthetic datasets for the Pagie Polynomial (ranging in size from 4096 to 16 million points), profiling training times of our algorithm with other standard symbolic regression libraries viz. gplearn, TensorGP and KarooGP. In addition, using 6 large-scale regression and classification datasets usually used for comparing gradient boosting algorithms, we run performance benchmarks on our algorithm and gplearn, profiling the training time, test accuracy, and loss. On an NVIDIA DGX-A100 GPU, our algorithm outperforms all the previously listed frameworks, and in particular, achieves average speedups of 119× and 40× against gplearn on the synthetic and large scale datasets respectively.


Developing Postfix-GP Framework for Symbolic Regression Problems

This paper describes Postfix-GP system, postfix notation based Genetic P...

On the Effectiveness of Genetic Operations in Symbolic Regression

This paper describes a methodology for analyzing the evolutionary dynami...

Taylor Genetic Programming for Symbolic Regression

Genetic programming (GP) is a commonly used approach to solve symbolic r...

Global solar irradiation prediction using a multi-gene genetic programming approach

In this paper, a nonlinear symbolic regression technique using an evolut...

Out-of-Core GPU Gradient Boosting

GPU-based algorithms have greatly accelerated many machine learning meth...

Lexicase Selection at Scale

Lexicase selection is a semantic-aware parent selection method, which as...