DeepAI AI Chat

Testing the Robustness of AutoML Systems

05/06/2020

∙

by Tuomas Halvari, et al.

∙

∙

Automated machine learning (AutoML) systems aim at finding the best machine learning (ML) pipeline that automatically matches the task and data at hand. We investigate the robustness of machine learning pipelines generated with three AutoML systems, TPOT, H2O, and AutoKeras. In particular, we study the influence of dirty data on the accuracy, and consider how using dirty training data may help to create more robust solutions. Furthermore, we also analyze how the structure of the generated pipelines differs in different cases.

Tuomas Halvari
1 publication
Jukka K. Nurminen
4 publications
Tommi Mikkonen
23 publications

∙ 06/11/2019

Toward Best Practices for Explainable B2B Machine Learning

To design tools and data pipelines for explainable B2B machine learning ...

0 Kit Kuksenok, et al. ∙

∙ 07/05/2019

Visus: An Interactive System for Automatic Machine Learning Model Building and Curation

While the demand for machine learning (ML) applications is booming, ther...

0 Aécio Santos, et al. ∙

∙ 02/28/2020

End-to-end Robustness for Sensing-Reasoning Machine Learning Pipelines

As machine learning (ML) being applied to many mission-critical scenario...

25 Zhuolin Yang, et al. ∙

∙ 02/09/2023

Hyperparameter Search Is All You Need For Training-Agnostic Backdoor Robustness

Commoditization and broad adoption of machine learning (ML) technologies...

0 Eugene Bagdasaryan, et al. ∙

∙ 10/08/2019

Analysis of an Automated Machine Learning Approach in Brain Predictive Modelling: A data-driven approach to Predict Brain Age from Cortical Anatomical Measures

The use of machine learning (ML) algorithms has significantly increased ...

29 Jessica Dafflon, et al. ∙

∙ 05/05/2022

Replicating Data Pipelines with GrimoireLab

In this paper, we present our MSR Hackathon 2022 project that replicates...

0 Kalvin Eng, et al. ∙

∙ 03/19/2022

METL: a modern ETL pipeline with a dynamic mapping matrix

Modern ETL streaming pipelines extract data from various sources and for...

0 Christian Haase, et al. ∙