Cluster-CAM: Cluster-Weighted Visual Interpretation of CNNs' Decision in Image Classification

02/03/2023
by   Zhenpeng Feng, et al.
0

Despite the tremendous success of convolutional neural networks (CNNs) in computer vision, the mechanism of CNNs still lacks clear interpretation. Currently, class activation mapping (CAM), a famous visualization technique to interpret CNN's decision, has drawn increasing attention. Gradient-based CAMs are efficient while the performance is heavily affected by gradient vanishing and exploding. In contrast, gradient-free CAMs can avoid computing gradients to produce more understandable results. However, existing gradient-free CAMs are quite time-consuming because hundreds of forward interference per image are required. In this paper, we proposed Cluster-CAM, an effective and efficient gradient-free CNN interpretation algorithm. Cluster-CAM can significantly reduce the times of forward propagation by splitting the feature maps into clusters in an unsupervised manner. Furthermore, we propose an artful strategy to forge a cognition-base map and cognition-scissors from clustered feature maps. The final salience heatmap will be computed by merging the above cognition maps. Qualitative results conspicuously show that Cluster-CAM can produce heatmaps where the highlighted regions match the human's cognition more precisely than existing CAMs. The quantitative evaluation further demonstrates the superiority of Cluster-CAM in both effectiveness and efficiency.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 8

page 10

research
09/15/2022

VS-CAM: Vertex Semantic Class Activation Mapping to Interpret Vision Graph Neural Network

Graph convolutional neural network (GCN) has drawn increasing attention ...
research
02/15/2021

Integrated Grad-CAM: Sensitivity-Aware Visual Explanation of Deep Convolutional Networks via Integrated Gradient-Based Scoring

Visualizing the features captured by Convolutional Neural Networks (CNNs...
research
05/28/2018

Improving the Resolution of CNN Feature Maps Efficiently with Multisampling

We describe a new class of subsampling techniques for CNNs, termed multi...
research
09/28/2022

Recipro-CAM: Gradient-free reciprocal class activation map

Convolutional neural network (CNN) becomes one of the most popular and p...
research
05/22/2022

Visual Explanations from Deep Networks via Riemann-Stieltjes Integrated Gradient-based Localization

Neural networks are becoming increasingly better at tasks that involve c...
research
11/16/2016

VisualBackProp: efficient visualization of CNNs

This paper proposes a new method, that we call VisualBackProp, for visua...
research
05/31/2018

Respond-CAM: Analyzing Deep Models for 3D Imaging Data by Visualizations

The convolutional neural network (CNN) has become a powerful tool for va...

Please sign up or login with your details

Forgot password? Click here to reset