Explainability Requires Interactivity

09/16/2021
by   Matthias Kirchler, et al.
21

When explaining the decisions of deep neural networks, simple stories are tempting but dangerous. Especially in computer vision, the most popular explanation approaches give a false sense of comprehension to its users and provide an overly simplistic picture. We introduce an interactive framework to understand the highly complex decision boundaries of modern vision models. It allows the user to exhaustively inspect, probe, and test a network's decisions. Across a range of case studies, we compare the power of our interactive approach to static explanation methods, showing how these can lead a user astray, with potentially severe consequences.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 12

page 13

research
11/03/2022

INGREX: An Interactive Explanation Framework for Graph Neural Networks

Graph Neural Networks (GNNs) are widely used in many modern applications...
research
02/12/2020

Self-explainability as an alternative to interpretability for judging the trustworthiness of artificial intelligences

The ability to explain decisions made by AI systems is highly sought aft...
research
08/18/2022

Transcending XAI Algorithm Boundaries through End-User-Inspired Design

The boundaries of existing explainable artificial intelligence (XAI) alg...
research
05/15/2019

TSXplain: Demystification of DNN Decisions for Time-Series using Natural Language and Statistical Features

Neural networks (NN) are considered as black-boxes due to the lack of ex...
research
02/12/2020

Self-explaining AI as an alternative to interpretable AI

The ability to explain decisions made by AI systems is highly sought aft...
research
03/17/2019

Model-Free Model Reconciliation

Designing agents capable of explaining complex sequential decisions rema...
research
01/10/2022

Evaluating Bayesian Model Visualisations

Probabilistic models inform an increasingly broad range of business and ...

Please sign up or login with your details

Forgot password? Click here to reset