Gradient Weighted Superpixels for Interpretability in CNNs

08/16/2019
by   Thomas Hartley, et al.
0

As Convolutional Neural Networks embed themselves into our everyday lives, the need for them to be interpretable increases. However, there is often a trade-off between methods that are efficient to compute but produce an explanation that is difficult to interpret, and those that are slow to compute but provide a more interpretable result. This is particularly challenging in problem spaces that require a large input volume, especially video which combines both spatial and temporal dimensions. In this work we introduce the idea of scoring superpixels through the use of gradient based pixel scoring techniques. We show qualitatively and quantitatively that this is able to approximate LIME, in a fraction of the time. We investigate our techniques using both image classification, and action recognition networks on large scale datasets (ImageNet and Kinetics-400 respectively).

READ FULL TEXT

page 3

page 4

page 5

page 7

research
02/15/2021

Integrated Grad-CAM: Sensitivity-Aware Visual Explanation of Deep Convolutional Networks via Integrated Gradient-Based Scoring

Visualizing the features captured by Convolutional Neural Networks (CNNs...
research
09/28/2019

Grouped Spatial-Temporal Aggregation for Efficient Action Recognition

Temporal reasoning is an important aspect of video analysis. 3D CNN show...
research
01/05/2018

Efficient Image Evidence Analysis of CNN Classification Results

Convolutional neural networks (CNNs) define the current state-of-the-art...
research
11/12/2019

Deep-Aligned Convolutional Neural Network for Skeleton-based Action Recognition and Segmentation

Convolutional neural networks (CNNs) are deep learning frameworks which ...
research
03/16/2022

Gate-Shift-Fuse for Video Action Recognition

Convolutional Neural Networks are the de facto models for image recognit...
research
11/26/2022

Towards Better Input Masking for Convolutional Neural Networks

The ability to remove features from the input of machine learning models...
research
12/11/2018

Diagnostic Visualization for Deep Neural Networks Using Stochastic Gradient Langevin Dynamics

The internal states of most deep neural networks are difficult to interp...

Please sign up or login with your details

Forgot password? Click here to reset