Explaining Explanations in AI

11/04/2018
by   Brent Mittelstadt, et al.
0

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained professionals how to predict what decisions will be made by the complex system, and most importantly how the system might break. However, when considering any such model it's important to remember Box's maxim that "All models are wrong but some are useful." We focus on the distinction between these models and explanations in philosophy and sociology. These models can be understood as a "do it yourself kit" for explanations, allowing a practitioner to directly answer "what if questions" or generate contrastive explanations without external assistance. Although a valuable ability, giving these models as explanations appears more difficult than necessary, and other forms of explanation may not have the same trade-offs. We contrast the different schools of thought on what makes an explanation, and suggest that machine learning might benefit from viewing the problem more broadly.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

10/06/2020

Efficient computation of contrastive explanations

With the increasing deployment of machine learning systems in practice, ...
01/19/2019

Explaining Explanations to Society

There is a disconnect between explanatory artificial intelligence (XAI) ...
01/28/2017

Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquy

When AI systems interact with humans in the loop, they are often called ...
06/20/2018

Towards Robust Interpretability with Self-Explaining Neural Networks

Most recent work on interpretability of complex machine learning models ...
06/18/2019

Model Explanations under Calibration

Explaining and interpreting the decisions of recommender systems are bec...
06/22/2020

Towards Contrastive Explanations for Comparing the Ethics of Plans

The development of robotics and AI agents has enabled their wider usage ...
05/28/2021

Do not explain without context: addressing the blind spot of model explanations

The increasing number of regulations and expectations of predictive mach...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.