Discriminability Tests for Visualization Effectiveness and Scalability

07/26/2019
by   Rafael Veras, et al.
0

The scalability of a particular visualization approach is limited by the ability for people to discern differences between plots made with different datasets. Ideally, when the data changes, the visualization changes in perceptible ways. This relation breaks down when there is a mismatch between the encoding and the character of the dataset being viewed. Unfortunately, visualizations are often designed and evaluated without fully exploring how they will respond to a wide variety of datasets. We explore the use of an image similarity measure, the Multi-Scale Structural Similarity Index (MS-SSIM), for testing the discriminability of a data visualization across a variety of datasets. MS-SSIM is able to capture the similarity of two visualizations across multiple scales, including low level granular changes and high level patterns. Significant data changes that are not captured by the MS-SSIM indicate visualizations of low discriminability and effectiveness. The measure's utility is demonstrated with two empirical studies. In the first, we compare human similarity judgments and MS-SSIM scores for a collection of scatterplots. In the second, we compute the discriminability values for a set of basic visualizations and compare them with empirical measurements of effectiveness. In both cases, the analyses show that the computational measure is able to approximate empirical results. Our approach can be used to rank competing encodings on their discriminability and to aid in selecting visualizations for a particular type of data distribution.

READ FULL TEXT

page 3

page 5

research
02/12/2021

Personalized Visualization Recommendation

Visualization recommendation work has focused solely on scoring visualiz...
research
07/15/2021

A Survey of Perception-Based Visualization Studies by Task

Knowledge of human perception has long been incorporated into visualizat...
research
04/04/2023

viz2viz: Prompt-driven stylized visualization generation using a diffusion model

Creating stylized visualization requires going beyond the limited, abstr...
research
09/15/2020

Communicative Visualizations as a Learning Problem

Significant research has provided robust task and evaluation languages f...
research
08/14/2023

When Provenance Aids and Complicates Reproducibility Judgments

It is well-established that the provenance of a scientific result is imp...
research
03/01/2021

Deep Colormap Extraction from Visualizations

This work presents a new approach based on deep learning to automaticall...

Please sign up or login with your details

Forgot password? Click here to reset