Automatic Machine Learning by Pipeline Synthesis using Model-Based Reinforcement Learning and a Grammar

05/24/2019
by   Iddo Drori, et al.
25

Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached state-of-the-art results with an order of magnitude speedup using reinforcement learning with self-play. In this work we extend AlphaD3M by using a pipeline grammar and a pre-trained model which generalizes from many different datasets and similar tasks. Our results demonstrate improved performance compared with our earlier work and existing methods on AutoML benchmark datasets for classification and regression tasks. In the spirit of reproducible research we make our data, models, and code publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/03/2021

AlphaD3M: Machine Learning Pipeline Synthesis

We introduce AlphaD3M, an automatic machine learning (AutoML) system bas...
research
03/07/2018

Transfer Automatic Machine Learning

Building effective neural networks requires many design choices. These i...
research
04/10/2019

ReinBo: Machine Learning pipeline search and configuration with Bayesian Optimization embedded Reinforcement Learning

Machine learning pipeline potentially consists of several stages of oper...
research
05/16/2022

Deep Apprenticeship Learning for Playing Games

In the last decade, deep learning has achieved great success in machine ...
research
11/29/2021

Naive Automated Machine Learning

An essential task of Automated Machine Learning (AutoML) is the problem ...
research
11/14/2018

Automatic Grammar Augmentation for Robust Voice Command Recognition

This paper proposes a novel pipeline for automatic grammar augmentation ...
research
04/29/2020

AxCell: Automatic Extraction of Results from Machine Learning Papers

Tracking progress in machine learning has become increasingly difficult ...

Please sign up or login with your details

Forgot password? Click here to reset