Benchmarking Automatic Machine Learning Frameworks

08/17/2018
by   Adithya Balaji, et al.
0

AutoML serves as the bridge between varying levels of expertise when designing machine learning systems and expedites the data science process. A wide range of techniques is taken to address this, however there does not exist an objective comparison of these techniques. We present a benchmark of current open source AutoML solutions using open source datasets. We test auto-sklearn, TPOT, auto_ml, and H2O's AutoML solution against a compiled set of regression and classification datasets sourced from OpenML and find that auto-sklearn performs the best across classification datasets and TPOT performs the best across regression datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/30/2020

PMLB v1.0: An open source dataset collection for benchmarking machine learning methods

Motivation: Novel machine learning and statistical modeling studies rely...
research
11/01/2021

OPF-Learn: An Open-Source Framework for Creating Representative AC Optimal Power Flow Datasets

Increasing levels of renewable generation motivate a growing interest in...
research
03/13/2020

AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data

We introduce AutoGluon-Tabular, an open-source AutoML framework that req...
research
07/01/2019

An Open Source AutoML Benchmark

In recent years, an active field of research has developed around automa...
research
08/31/2018

Open Source Dataset and Machine Learning Techniques for Automatic Recognition of Historical Graffiti

Machine learning techniques are presented for automatic recognition of t...
research
07/25/2022

AMLB: an AutoML Benchmark

Comparing different AutoML frameworks is notoriously challenging and oft...
research
07/16/2021

LeanML: A Design Pattern To Slash Avoidable Wastes in Machine Learning Projects

We introduce the first application of the lean methodology to machine le...

Please sign up or login with your details

Forgot password? Click here to reset