Automatic Componentwise Boosting: An Interpretable AutoML System

09/12/2021
by   Stefan Coors, et al.
0

In practice, machine learning (ML) workflows require various different steps, from data preprocessing, missing value imputation, model selection, to model tuning as well as model evaluation. Many of these steps rely on human ML experts. AutoML - the field of automating these ML pipelines - tries to help practitioners to apply ML off-the-shelf without any expert knowledge. Most modern AutoML systems like auto-sklearn, H20-AutoML or TPOT aim for high predictive performance, thereby generating ensembles that consist almost exclusively of black-box models. This, in turn, makes the interpretation for the layperson more intricate and adds another layer of opacity for users. We propose an AutoML system that constructs an interpretable additive model that can be fitted using a highly scalable componentwise boosting algorithm. Our system provides tools for easy model interpretation such as visualizing partial effects and pairwise interactions, allows for a straightforward calculation of feature importance, and gives insights into the required model complexity to fit the given task. We introduce the general framework and outline its implementation autocompboost. To demonstrate the frameworks efficacy, we compare autocompboost to other existing systems based on the OpenML AutoML-Benchmark. Despite its restriction to an interpretable model space, our system is competitive in terms of predictive performance on most data sets while being more user-friendly and transparent.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/08/2020

Pitfalls to Avoid when Interpreting Machine Learning Models

Modern requirements for machine learning (ML) models include both high p...
research
01/13/2021

Preferential Mixture-of-Experts: Interpretable Models that Rely on Human Expertise as much as Possible

We propose Preferential MoE, a novel human-ML mixture-of-experts model t...
research
03/19/2023

AutoEn: An AutoML method based on ensembles of predefined Machine Learning pipelines for supervised Traffic Forecasting

Intelligent Transportation Systems are producing tons of hardly manageab...
research
07/14/2020

Model-Agnostic Interpretable and Data-driven suRRogates suited for highly regulated industries

Highly regulated industries, like banking and insurance, ask for transpa...
research
07/14/2022

Using Model-Based Trees with Boosting to Fit Low-Order Functional ANOVA Models

Low-order functional ANOVA (fANOVA) models have been rediscovered in the...
research
03/17/2022

GAM(L)A: An econometric model for interpretable Machine Learning

Despite their high predictive performance, random forest and gradient bo...
research
07/31/2020

Rethinking Defaults Values: a Low Cost and Efficient Strategy to Define Hyperparameters

Machine Learning (ML) algorithms have been successfully employed by a va...

Please sign up or login with your details

Forgot password? Click here to reset