Generalized Integrated Gradients: A practical method for explaining diverse ensembles

09/04/2019
by   John Merrill, et al.
0

We introduce Generalized Integrated Gradients (GIG), a formal extension of the Integrated Gradients (IG) (Sundararajan et al., 2017) method for attributing credit to the input variables of a predictive model. GIG improves IG by explaining a broader variety of functions that arise from practical applications of ML in domains like financial services. GIG is constructed to overcome limitations of Shapley (1953) and Aumann-Shapley (1974), and has desirable properties when compared to other approaches. We prove GIG is the only correct method, under a small set of reasonable axioms, for providing explanations for mixed-type models or games. We describe the implementation, and present results of experiments on several datasets and systems of models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/27/2017

Case Study: Explaining Diabetic Retinopathy Detection Deep CNNs via Integrated Gradients

In this report, we applied integrated gradients to explaining a neural n...
research
11/21/2018

Compensated Integrated Gradients to Reliably Interpret EEG Classification

Integrated gradients are widely employed to evaluate the contribution of...
research
07/21/2020

Pattern-Guided Integrated Gradients

Integrated Gradients (IG) and PatternAttribution (PA) are two establishe...
research
02/10/2020

Explaining Explanations: Axiomatic Feature Interactions for Deep Networks

Recent work has shown great promise in explaining neural network behavio...
research
06/06/2019

Segment Integrated Gradients: Better attributions through regions

Saliency methods can aid understanding of deep neural networks. Recent y...
research
08/31/2021

Discretized Integrated Gradients for Explaining Language Models

As a prominent attribution-based explanation algorithm, Integrated Gradi...
research
12/31/2009

On a Model for Integrated Information

In this paper we give a thorough presentation of a model proposed by Ton...

Please sign up or login with your details

Forgot password? Click here to reset