Gradient-Based Interpretability Methods and Binarized Neural Networks

06/23/2021

∙

Binarized Neural Networks (BNNs) have the potential to revolutionize the way that deep learning is carried out in edge computing platforms. However, the effectiveness of interpretability methods on these networks has not been assessed. In this paper, we compare the performance of several widely used saliency map-based interpretabilty techniques (Gradient, SmoothGrad and GradCAM), when applied to Binarized or Full Precision Neural Networks (FPNNs). We found that the basic Gradient method produces very similar-looking maps for both types of network. However, SmoothGrad produces significantly noisier maps for BNNs. GradCAM also produces saliency maps which differ between network types, with some of the BNNs having seemingly nonsensical explanations. We comment on possible reasons for these differences in explanations and present it as an example of why interpretability techniques should be tested on a wider range of network types.

READ FULL TEXT

Gradient-Based Interpretability Methods and Binarized Neural Networks

Improving Interpretability in Medical Imaging Diagnosis using Adversarial Training

Why are Saliency Maps Noisy? Cause of and Solution to Noisy Saliency Maps

Evaluating Post-hoc Interpretability with Intrinsic Interpretability

Backdoor Attacks on the DNN Interpretation System

Improving Interpretability for Computer-aided Diagnosis tools on Whole Slide Imaging with Multiple Instance Learning and Gradient-based Explanations

Policy Distillation with Selective Input Gradient Regularization for Efficient Interpretability

Improving Deep Learning Interpretability by Saliency Guided Training

Gradient-Based Interpretability Methods and Binarized Neural Networks

Related Research

Improving Interpretability in Medical Imaging Diagnosis using Adversarial Training

Why are Saliency Maps Noisy? Cause of and Solution to Noisy Saliency Maps

Evaluating Post-hoc Interpretability with Intrinsic Interpretability

Backdoor Attacks on the DNN Interpretation System

Improving Interpretability for Computer-aided Diagnosis tools on Whole Slide Imaging with Multiple Instance Learning and Gradient-based Explanations

Policy Distillation with Selective Input Gradient Regularization for Efficient Interpretability

Improving Deep Learning Interpretability by Saliency Guided Training