Generalized SHAP: Generating multiple types of explanations in machine learning

06/12/2020
by   Dillon Bowen, et al.
0

Many important questions about a model cannot be answered just explaining how much each feature contributes its output. To answer a broader set of questions, we generalize a popular, mathematically well-grounded explanation technique, Shapley Additive Explanations (SHAP). Our new method - Generalized Shapley Additive Explanations (G-SHAP) - produces many additional types of explanations including: 1) General classification explanations; Why is this sample more likely to belong to one class rather than another? 2) Intergroup differences; Why do our model's predictions differ between groups of observations? 3) Model failure; Why does our model perform poorly on a given sample? We formally define these types of explanations and illustrate their practical use on real data.

READ FULL TEXT
research
03/27/2019

iBreakDown: Uncertainty of Model Explanations for Non-additive Predictive Models

Explainable Artificial Intelligence (XAI) brings a lot of attention rece...
research
06/22/2021

On the Diversity and Limits of Human Explanations

A growing effort in NLP aims to build datasets of human explanations. Ho...
research
02/16/2015

Explaining robust additive utility models by sequences of preference swaps

Multicriteria decision analysis aims at supporting a person facing a dec...
research
06/07/2021

Accurate and robust Shapley Values for explaining predictions and focusing on local important variables

Although Shapley Values (SV) are widely used in explainable AI, they can...
research
03/03/2020

Explaining Groups of Points in Low-Dimensional Representations

A common workflow in data exploration is to learn a low-dimensional repr...
research
07/09/2018

Evaluating Active Learning Heuristics for Sequential Diagnosis

Given a malfunctioning system, sequential diagnosis aims at identifying ...
research
03/28/2023

Understanding and Exploring the Whole Set of Good Sparse Generalized Additive Models

In real applications, interaction between machine learning model and dom...

Please sign up or login with your details

Forgot password? Click here to reset