Grad-CAM++: Generalized Gradient-based Visual Explanations for Deep Convolutional Networks

10/30/2017
by   Aditya Chattopadhyay, et al.
0

Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision based problems. However, deep models are perceived as "black box" methods considering the lack of understanding of their internal functioning. There has been a significant recent interest to develop explainable deep learning models, and this paper is an effort in this direction. Building on a recently proposed method called Grad-CAM, we propose Grad-CAM++ to provide better visual explanations of CNN model predictions (when compared to Grad-CAM), in terms of better localization of objects as well as explaining occurrences of multiple objects of a class in a single image. We provide a mathematical explanation for the proposed method, Grad-CAM++, which uses a weighted combination of the positive partial derivatives of the last convolutional layer feature maps with respect to a specific class score as weights to generate a visual explanation for the class label under consideration. Our extensive experiments and evaluations, both subjective and objective, on standard datasets showed that Grad-CAM++ indeed provides better visual explanations for a given CNN architecture when compared to Grad-CAM.

READ FULL TEXT

page 3

page 4

page 6

page 8

page 9

page 13

page 14

research
08/03/2019

Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Models

Gaining insight into how deep convolutional neural network models perfor...
research
06/25/2020

SS-CAM: Smoothed Score-CAM for Sharper Visual Feature Localization

Deep Convolution Neural Networks are often referred to as black-box mode...
research
03/01/2023

SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspective

Researchers have proposed various methods for visually interpreting the ...
research
11/23/2022

Crown-CAM: Reliable Visual Explanations for Tree Crown Detection in Aerial Images

Visual explanation of "black-box" models has enabled researchers and exp...
research
05/22/2022

Grad-CAM++ is Equivalent to Grad-CAM With Positive Gradients

The Grad-CAM algorithm provides a way to identify what parts of an image...
research
05/31/2018

Respond-CAM: Analyzing Deep Models for 3D Imaging Data by Visualizations

The convolutional neural network (CNN) has become a powerful tool for va...
research
12/09/2021

Model Doctor: A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifiers

Recently, Convolutional Neural Network (CNN) has achieved excellent perf...

Please sign up or login with your details

Forgot password? Click here to reset