A unified view of gradient-based attribution methods for Deep Neural Networks

11/16/2017
by   Marco Ancona, et al.
0

Understanding the flow of information in Deep Neural Networks is a challenging problem that has gain increasing attention over the last few years. While several methods have been proposed to explain network predictions, only few attempts to analyze them from a theoretical perspective have been made in the past. In this work we analyze various state-of-the-art attribution methods and prove unexplored connections between them. We also show how some methods can be reformulated and more conveniently implemented. Finally, we perform an empirical evaluation with six attribution methods on a variety of tasks and architectures and discuss their strengths and limitations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2023

Understanding and Unifying Fourteen Attribution Methods with Taylor Interactions

Various attribution methods have been developed to explain deep neural n...
research
03/26/2019

Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximation

The problem of explaining the behavior of deep neural networks has gaine...
research
02/15/2021

Attribution Mask: Filtering Out Irrelevant Features By Recursively Focusing Attention on Inputs of DNNs

Attribution methods calculate attributions that visually explain the pre...
research
06/19/2023

Interpreting Deep Neural Networks with the Package innsight

The R package innsight offers a general toolbox for revealing variable-w...
research
12/20/2019

Background Hardly Matters: Understanding Personality Attribution in Deep Residual Networks

Perceived personality traits attributed to an individual do not have to ...
research
05/20/2022

Towards Better Understanding Attribution Methods

Deep neural networks are very successful on many vision tasks, but hard ...
research
06/22/2023

Pre or Post-Softmax Scores in Gradient-based Attribution Methods, What is Best?

Gradient based attribution methods for neural networks working as classi...

Please sign up or login with your details

Forgot password? Click here to reset