Breaking Batch Normalization for better explainability of Deep Neural Networks through Layer-wise Relevance Propagation

02/24/2020
by   Mathilde Guillemot, et al.
0

The lack of transparency of neural networks stays a major break for their use. The Layerwise Relevance Propagation technique builds heat-maps representing the relevance of each input in the model s decision. The relevance spreads backward from the last to the first layer of the Deep Neural Network. Layer-wise Relevance Propagation does not manage normalization layers, in this work we suggest a method to include normalization layers. Specifically, we build an equivalent network fusing normalization layers and convolutional or fully connected layers. Heatmaps obtained with our method on MNIST and CIFAR 10 datasets are more accurate for convolutional layers. Our study also prevents from using Layerwise Relevance Propagation with networks including a combination of connected layers and normalization layer.

READ FULL TEXT

page 6

page 7

research
04/04/2016

Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layers

Layer-wise relevance propagation is a framework which allows to decompos...
research
06/17/2021

Backward Gradient Normalization in Deep Neural Networks

We introduce a new technique for gradient normalization during neural ne...
research
07/17/2018

Layer-wise Relevance Propagation for Explainable Recommendations

In this paper, we tackle the problem of explanations in a deep-learning ...
research
02/23/2023

Fact or Artifact? Revise Layer-wise Relevance Propagation on various ANN Architectures

Layer-wise relevance propagation (LRP) is a widely used and powerful tec...
research
02/07/2023

On the Ideal Number of Groups for Isometric Gradient Propagation

Recently, various normalization layers have been proposed to stabilize t...
research
06/08/2023

Normalization-Equivariant Neural Networks with Application to Image Denoising

In many information processing systems, it may be desirable to ensure th...
research
09/05/2020

Generalization on the Enhancement of Layerwise Relevance Interpretability of Deep Neural Network

The practical application of deep neural networks are still limited by t...

Please sign up or login with your details

Forgot password? Click here to reset