The Inadequacy of Shapley Values for Explainability

02/16/2023
by   Xuanxiang Huang, et al.
0

This paper develops a rigorous argument for why the use of Shapley values in explainable AI (XAI) will necessarily yield provably misleading information about the relative importance of features for predictions. Concretely, this paper demonstrates that there exist classifiers, and associated predictions, for which the relative importance of features determined by the Shapley values will incorrectly assign more importance to features that are provably irrelevant for the prediction, and less importance to features that are provably relevant for the prediction. The paper also argues that, given recent complexity results, the existence of efficient algorithms for the computation of rigorous feature attribution values in the case of some restricted classes of classifiers should be deemed unlikely at best.

READ FULL TEXT

page 21

page 24

research
09/06/2023

A Refutation of Shapley Values for Explainability

Recent work demonstrated the existence of Boolean functions for which Sh...
research
07/23/2021

Joint Shapley values: a measure of joint feature importance

The Shapley value is one of the most widely used model-agnostic measures...
research
03/23/2022

On Understanding the Influence of Controllable Factors with a Feature Attribution Algorithm: a Medical Case Study

Feature attribution XAI algorithms enable their users to gain insight in...
research
06/19/2017

Consistent feature attribution for tree ensembles

It is critical in many applications to understand what features are impo...
research
01/05/2023

Semantic match: Debugging feature attribution methods in XAI for healthcare

The recent spike in certified Artificial Intelligence (AI) tools for hea...
research
11/06/2021

"How Does It Detect A Malicious App?" Explaining the Predictions of AI-based Android Malware Detector

AI methods have been proven to yield impressive performance on Android m...
research
03/10/2023

Feature Importance: A Closer Look at Shapley Values and LOCO

There is much interest lately in explainability in statistics and machin...

Please sign up or login with your details

Forgot password? Click here to reset