Causal Support: Modeling Causal Inferences with Visualizations

07/28/2021
by   Alex Kale, et al.
0

Analysts often make visual causal inferences about possible data-generating models. However, visual analytics (VA) software tends to leave these models implicit in the mind of the analyst, which casts doubt on the statistical validity of informal visual "insights". We formally evaluate the quality of causal inferences from visualizations by adopting causal support – a Bayesian cognition model that learns the probability of alternative causal explanations given some data – as a normative benchmark for causal inferences. We contribute two experiments assessing how well crowdworkers can detect (1) a treatment effect and (2) a confounding relationship. We find that chart users' causal inferences tend to be insensitive to sample size such that they deviate from our normative benchmark. While interactively cross-filtering data in visualizations can improve sensitivity, on average users do not perform reliably better with common visualizations than they do with textual contingency tables. These experiments demonstrate the utility of causal support as an evaluation framework for inferences in VA and point to opportunities to make analysts' mental models more explicit in VA software.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2020

Causal Inference in Genetic Trio Studies

We introduce a method to rigorously draw causal inferences—inferences im...
research
11/17/2020

Confounding Feature Acquisition for Causal Effect Estimation

Reliable treatment effect estimation from observational data depends on ...
research
02/06/2018

How to Make Causal Inferences Using Texts

New text as data techniques offer a great promise: the ability to induct...
research
09/16/2020

GLUCOSE: GeneraLized and COntextualized Story Explanations

When humans read or listen, they make implicit commonsense inferences th...
research
08/02/2020

Structural Causal Models Are (Solvable by) Credal Networks

A structural causal model is made of endogenous (manifest) and exogenous...
research
01/26/2017

The Causal Frame Problem: An Algorithmic Perspective

The Frame Problem (FP) is a puzzle in philosophy of mind and epistemolog...

Please sign up or login with your details

Forgot password? Click here to reset