DeepAI
Log In Sign Up

Outcome-Explorer: A Causality Guided Interactive Visual Interface for Interpretable Algorithmic Decision Making

01/03/2021
by   Md. Naimul Hoque, et al.
0

The widespread adoption of algorithmic decision-making systems has brought about the necessity to interpret the reasoning behind these decisions. The majority of these systems are complex black box models, and auxiliary models are often used to approximate and then explain their behavior. However, recent research suggests that such explanations are not overly accessible to non-expert users and can lead to incorrect interpretation of the underlying model. In this paper, we show that a predictive and interactive model based on causality is inherently interpretable, does not require any auxiliary model, and allows both expert and non-expert users to understand the model comprehensively. To demonstrate our method we developed Outcome Explorer, a causality guided interactive interface, and evaluated it by conducting think-aloud sessions with three expert users and a user study with 18 non-expert users. All three expert users found our tool to be comprehensive in supporting their explanation needs while the non-expert users were able to understand the inner workings of the model easily.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/01/2017

Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR

There has been much discussion of the right to explanation in the EU Gen...
11/26/2018

Please Stop Explaining Black Box Models for High Stakes Decisions

There are black box models now being used for high stakes decision-makin...
05/28/2018

Local Rule-Based Explanations of Black Box Decision Systems

The recent years have witnessed the rise of accurate but obscure decisio...
06/11/2022

VAC2: Visual Analysis of Combined Causality in Event Sequences

Identifying causality behind complex systems plays a significant role in...
01/10/2022

Evaluating Bayesian Model Visualisations

Probabilistic models inform an increasingly broad range of business and ...
08/06/2021

Interpretable Summaries of Black Box Incident Triaging with Subgroup Discovery

The need of predictive maintenance comes with an increasing number of in...
11/19/2020

RADAR-X: An Interactive Interface Pairing Contrastive Explanations with Revised Plan Suggestions

Empowering decision support systems with automated planning has received...