DeepAI AI Chat
Log In Sign Up

Neo: Generalizing Confusion Matrix Visualization to Hierarchical and Multi-Output Labels

10/24/2021
by   Jochen Görtler, et al.
University of Konstanz
13

The confusion matrix, a ubiquitous visualization for helping people evaluate machine learning models, is a tabular layout that compares predicted class labels against actual class labels over all data instances. We conduct formative research with machine learning practitioners at a large technology company and find that conventional confusion matrices do not support more complex data-structures found in modern-day applications, such as hierarchical and multi-output labels. To express such variations of confusion matrices, we design an algebra that models confusion matrices as probability distributions. Based on this algebra, we develop Neo, a visual analytics system that enables practitioners to flexibly author and interact with hierarchical and multi-output confusion matrices, visualize derived metrics, renormalize confusions, and share matrix specifications. Finally, we demonstrate Neo's utility with three case studies that help people better understand model performance and reveal hidden confusions.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/17/2019

Explaining Vulnerabilities to Adversarial Machine Learning through Visual Analytics

Machine learning models are currently being deployed in a variety of rea...
07/27/2022

Calibrate: Interactive Analysis of Probabilistic Model Output

Analyzing classification model performance is a crucial task for machine...
02/08/2021

Learning with Density Matrices and Random Features

A density matrix describes the statistical state of a quantum system. It...
01/30/2022

ClassSPLOM – A Scatterplot Matrix to Visualize Separation of Multiclass Multidimensional Data

In multiclass classification of multidimensional data, the user wants to...
06/29/2021

Distributed Matrix Tiling Using A Hypergraph Labeling Formulation

Partitioning large matrices is an important problem in distributed linea...
02/04/2019

Confusion matrices and rough set data analysis

A widespread approach in machine learning to evaluate the quality of a c...