InstanceFlow: Visualizing the Evolution of Classifier Confusion on the Instance Level

07/22/2020
by   Michael Pühringer, et al.
0

Classification is one of the most important supervised machine learning tasks. During the training of a classification model, the training instances are fed to the model multiple times (during multiple epochs) in order to iteratively increase the classification performance. The increasing complexity of models has led to a growing demand for model interpretabilty through visualizations. Existing approaches mostly focus on the visual analysis of the final model performance after training and are often limited to aggregate performance measures. In this paper we introduce InstanceFlow, a novel dual-view visualization tool that allows users to analyze the learning behavior of classifiers over time on the instance-level. A Sankey diagram visualizes the flow of instances throughout epochs, with on-demand detailed glyphs and traces for individual instances. A tabular view allows users to locate interesting instances by ranking and filtering. In this way, InstanceFlow bridges the gap between class-level and instance-level performance evaluation while enabling users to perform a full temporal analysis of the training process.

READ FULL TEXT

page 1

page 3

research
12/14/2020

A Visual Mining Approach to Improved Multiple-Instance Learning

Multiple-instance learning (MIL) is a paradigm of machine learning that ...
research
10/02/2019

ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusion

Classifiers are among the most widely used supervised machine learning a...
research
05/30/2023

Shapley Based Residual Decomposition for Instance Analysis

In this paper, we introduce the idea of decomposing the residuals of reg...
research
07/31/2019

A Novel Multiple Classifier Generation and Combination Framework Based on Fuzzy Clustering and Individualized Ensemble Construction

Multiple classifier system (MCS) has become a successful alternative for...
research
01/03/2023

Data Valuation Without Training of a Model

Many recent works on understanding deep learning try to quantify how muc...
research
08/02/2019

A Visual Technique to Analyze Flow of Information in a Machine Learning System

Machine learning (ML) algorithms and machine learning based software sys...
research
03/02/2018

A multi-instance deep neural network classifier: application to Higgs boson CP measurement

We investigate properties of a classifier applied to the measurements of...

Please sign up or login with your details

Forgot password? Click here to reset