explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning

07/29/2019
by   Thilo Spinner, et al.
11

We propose a framework for interactive and explainable machine learning that enables users to (1) understand machine learning models; (2) diagnose model limitations using different explainable AI methods; as well as (3) refine and optimize the models. Our framework combines an iterative XAI pipeline with eight global monitoring and steering mechanisms, including quality monitoring, provenance tracking, model comparison, and trust building. To operationalize the framework, we present explAIner, a visual analytics system for interactive and explainable machine learning that instantiates all phases of the suggested pipeline within the commonly used TensorBoard environment. We performed a user-study with nine participants across different expertise levels to examine their perception of our workflow and to collect suggestions to fill the gap between our system and framework. The evaluation confirms that our tightly integrated system leads to an informed machine learning process while disclosing opportunities for further extensions.

READ FULL TEXT

page 1

page 4

page 6

page 8

research
02/24/2022

XAutoML: A Visual Analytics Tool for Establishing Trust in Automated Machine Learning

In the last ten years, various automated machine learning (AutoML) syste...
research
04/09/2021

Model LineUpper: Supporting Interactive Model Comparison at Multiple Levels for AutoML

Automated Machine Learning (AutoML) is a rapidly growing set of technolo...
research
02/07/2022

Introducing explainable supervised machine learning into interactive feedback loops for statistical production system

Statistical production systems cover multiple steps from the collection,...
research
08/01/2018

Manifold: A Model-Agnostic Framework for Interpretation and Diagnosis of Machine Learning Models

Interpretation and diagnosis of machine learning models have gained rene...
research
07/22/2023

Exploring MLOps Dynamics: An Experimental Analysis in a Real-World Machine Learning Project

This article presents an experiment focused on optimizing the MLOps (Mac...
research
11/03/2021

AlphaD3M: Machine Learning Pipeline Synthesis

We introduce AlphaD3M, an automatic machine learning (AutoML) system bas...
research
09/26/2022

An Explainable Machine Learning Approach to Visual-Interactive Labeling: A Case Study on Non-communicable Disease Data

We introduce a new visual-interactive tool: Explainable Labeling Assista...

Please sign up or login with your details

Forgot password? Click here to reset