L-Shapley and C-Shapley: Efficient Model Interpretation for Structured Data

08/08/2018
by   Jianbo Chen, et al.
0

We study instancewise feature importance scoring as a method for model interpretation. Any such method yields, for each predicted instance, a vector of importance scores associated with the feature vector. Methods based on the Shapley score have been proposed as a fair way of computing feature attributions of this kind, but incur an exponential complexity in the number of features. This combinatorial explosion arises from the definition of the Shapley value and prevents these methods from being scalable to large data sets and complex models. We focus on settings in which the data have a graph structure, and the contribution of features to the target variable is well-approximated by a graph-structured factorization. In such settings, we develop two algorithms with linear complexity for instancewise feature importance scoring. We establish the relationship of our methods to the Shapley value and another closely related concept known as the Myerson value from cooperative game theory. We demonstrate on both language and image data that our algorithms compare favorably with other methods for model interpretation.

READ FULL TEXT
research
02/11/2019

LS-Tree: Model Interpretation When the Data Are Linguistic

We study the problem of interpreting trained classification models in th...
research
01/28/2022

Explaining Graph-level Predictions with Communication Structure-Aware Cooperative Games

Explaining predictions made by machine learning models is important and ...
research
02/13/2021

Variable importance scores

Scoring of variables for importance in predicting a response is an ill-d...
research
12/14/2018

Efficient Interpretation of Deep Learning Models Using Graph Structure and Cooperative Game Theory: Application to ASD Biomarker Discovery

Discovering imaging biomarkers for autism spectrum disorder (ASD) is cri...
research
08/12/2020

Predictive and Causal Implications of using Shapley Value for Model Interpretation

Shapley value is a concept from game theory. Recently, it has been used ...
research
09/27/2022

WeightedSHAP: analyzing and improving Shapley based feature attributions

Shapley value is a popular approach for measuring the influence of indiv...
research
10/15/2020

Marginal Contribution Feature Importance – an Axiomatic Approach for The Natural Case

When training a predictive model over medical data, the goal is sometime...

Please sign up or login with your details

Forgot password? Click here to reset