ATMSeer: Increasing Transparency and Controllability in Automated Machine Learning

02/13/2019
by   Qianwen Wang, et al.
6

To relieve the pain of manually selecting machine learning algorithms and tuning hyperparameters, automated machine learning (AutoML) methods have been developed to automatically search for good models. Due to the huge model search space, it is impossible to try all models. Users tend to distrust automatic results and increase the search budget as much as they can, thereby undermining the efficiency of AutoML. To address these issues, we design and implement ATMSeer, an interactive visualization tool that supports users in refining the search space of AutoML and analyzing the results. To guide the design of ATMSeer, we derive a workflow of using AutoML based on interviews with machine learning experts. A multi-granularity visualization is proposed to enable users to monitor the AutoML process, analyze the searched models, and refine the search space in real time. We demonstrate the utility and usability of ATMSeer through two case studies, expert interviews, and a user study with 13 end users.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 7

page 9

page 10

page 11

research
09/04/2020

HyperTendril: Visual Analytics for User-Driven Hyperparameter Optimization of Deep Neural Networks

To mitigate the pain of manually tuning hyperparameters of deep neural n...
research
03/12/2020

PyODDS: An End-to-end Outlier Detection System with Automated Machine Learning

Outlier detection is an important task for various data mining applicati...
research
06/07/2022

DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning

Automated Machine Learning (AutoML) is used more than ever before to sup...
research
05/17/2023

Odyssey: An Interactive Workbench for Expert-Driven Floating-Point Expression Rewriting

In recent years, researchers have proposed a number of automated tools t...
research
09/25/2017

Towards automation of data quality system for CERN CMS experiment

Daily operation of a large-scale experiment is a challenging task, parti...
research
11/27/2021

AutoTSC: Optimization Algorithm to Automatically Solve the Time Series Classification Problem

Nowadays Automated Machine Learning, abbrevi- ated AutoML, is recognize...
research
12/18/2022

AutoSlicer: Scalable Automated Data Slicing for ML Model Analysis

Automated slicing aims to identify subsets of evaluation data where a tr...

Please sign up or login with your details

Forgot password? Click here to reset