U-CAM: Visual Explanation using Uncertainty based Class Activation Maps

1 Introduction

To interpret and explain the deep learning models, many approaches have been proposed. One of the approaches uses probabilistic techniques to obtain uncertainty estimates, [17, 18]. Other approaches aim at obtaining visual explanations through methods such as Grad-CAM [9] or by attending to specific regions using hard/soft attention. With the recent probabilistic deep learning techniques by Gal and Ghahramani [17], it became feasible to obtain uncertainty estimates in a computationally efficient manner. This was further extended to data uncertainty and model uncertainty based estimates [25]. Through this work, we focus on using gradients uncertainty losses to improve attention maps while also enhancing the explainability leveraging the Bayesian nature of our approach. The uncertainties that we use are aleatoric and predictive[26].

Figure 1: The figure shows the activation maps for baseline (MCB[15]) and our models (A-GCA and P-GCA). In the first example, the baseline model had predicted the wrong answer and had high uncertainty in prediction. ( $σ_{u}$ denotes uncertainty, see Section 3). Our model gave a correct answer while also minimizing the uncertainty (thus leading to an improved visual explanation).

For the estimated uncertainties, we calculate gradients using the approach similar to gradient-based class activation maps [9]. This provides “certainty maps” which helps in attending to certain regions of the attention maps. Doing this, we report an improvement in attention maps. This is illustrated in the Figure 1.

Our method combines techniques from both the explanation [9] and uncertainty [25]

estimation techniques to obtain improved results. We have provided an extensive evaluation. We show that the results obtained for uncertainty estimates show a strong correlation with misclassification, i.e., when the classifier is wrong, the model is usually uncertain. Further, the attention maps provide state of the art correlation with human-annotated attention maps. We also show that on various VQA datasets, our model provides results comparable to the state of the art while significantly improving the performance of baseline methods on which we incorporated our approach. Our method may be seen as a generic way to obtain Bayesian uncertainty estimates, visual explanation, and as a result, improved accuracy for Visual Question Answering (VQA) task.

Our contributions, therefore, lie in, a) unifying approaches for understanding deep learning methods using uncertainty estimate and explanation b) obtaining visual attention maps that correlate best with human attention regions and c) showing that the improved attention maps result in consistent improvement in results. This is particularly suited for vision and language-based tasks where we are interested in understanding visual grounding, i.e., for instance, if the answer for a question is ‘dog’ (Corresponding question: ‘Who is on the boat?’), it is important to understand whether the model is certain and whether it is focusing on the correct regions containing a dog. This important requirement is met by the proposed approach.

Data uncertainty in a multi-modal setting, Uncertainty in VQA task is two-fold. In the example below, Question, ”Which kind of animal is it?” when asked (irrespective of image), may not be concretely answered. Also, seeing the image alone, in the given setting, the animal (especially the one behind) could easily be mis-classified as a dog or some other animal. These kinds of data uncertainties are tapped & hence minimized best when we consider uncertainties of the fused input (image+question). In Figure 2, we show the resultant attention maps of baseline (not minimizing uncertainty) & when we tried to minimize only-image, only-question & the fused uncertainty respectively.

Figure 2: The first column is the original image. 2nd, 3rd, 4th, and 5th columns represent the baseline attention, attention when only image uncertainty was minimized, attention when only question uncertainty was minimized, attention when both image and question uncertainties were minimized (proposed model) respectively.

2 Related work

The task of Visual question answering [36, 2, 41, 19, 37] is well studied in the vision and language community, but it has been relatively less explored for providing explanation[42] for answer prediction. Recently, lot of works that focus on explanation models, one of that is image captioning for provide basic explanation for image [5, 12, 29, 46, 49, 23, 52, 11, 7, 21, 53]. [39] has proposed an exemplar-based explanation method for generating question based on the image. Similarly, [40] has suggested a discriminator based method to obtain an explanation for paraphrase generation in text. In VQA, [56][51] have proposed interesting methods for improving attention in the question. Work that explores image and question jointly and is based on hierarchical co-attention is [34]. [43, 54, 33, 38] have proposed attention-based methods for the explanation in VQA, which use question to attend over specific regions in an image. [15, 28, 27] have suggested exciting works that advocate multimodal pooling and obtain close to state of the art in VQA. [38] has proposed an exemplar-based explanation method to improve attention in VQA. We can do systematic comparison of image-based attention while correlating with human attention maps as shown by [8]. Also, we need to ensure that our approach works in other dataset distributions [30, 32] of images while taking less time [44] to train our explanation model.

Recently a lot of researchers have focused on estimating uncertainty in the predictions using deep learning. [6]

has first proposed a method to learn uncertainty in the weights of the neural network. Kendall

et.al. [24]

has proposed method to measure model uncertainty for image segmentation task. They observed that softmax probability function approximates relative probability between the class labels, but does not provide information about the model’s uncertainty. The work by

[17, 14] estimates model uncertainty of the deep network (CNN, RNN) with the help of dropout [47]. [48]

has estimated uncertainty for batch normalized deep networks.

[25, 26, 45] have mainly decomposed predictive uncertainty into two major types, namely aleatoric and epistemic uncertainty, which capture uncertainty about the predicted model and uncertainty present in the data itself. [35] suggested a method to measure predictive uncertainty with the help of model and data uncertainty. Recently, [31] proposed a certainty method to bring two data distributions close for the domain adaption task. Here, our objective is to analyze and minimize the uncertainty in attention mask to predict answer in VQA. In our approach, We are proposing a gradient-based certainty explanation mask which minimizes uncertainty in attention regions to improve the correct answer’s predicted probability in VQA. Our method also provides visual explanation based on uncertainty class activation maps, capturing and visualizing the uncertainties present in the attention maps in VQA.

3 Modeling Uncertainty

We consider two type of uncertainties to model uncertainty present in the network, one due to uncertainty present in the data (Aleatoric), and the other due to model (Epistemic uncertainty).

3.1 Modeling Aleatoric Uncertainty

Given an input $x_{i}$ the model ( $G$

) predicts the logit output

{^y}_{i}

which is then an input to uncertainty network (

U

) for obtaining the variance

σ_{i}^{2}

as shown in Figure-3. To capture Aleatoric uncertainty [25], we learn the observational noise parameter

σ_{i}

for each input point

x_{i}

. Then, Aleatoric uncertainty,

(σ_{a}^{2})_{i}

is estimated by applying softplus function on the output logit variance. This is given by,

(σ_{a}^{2})_{i} = S o f t p l u s (σ_{i}^{2}) = l o g (1 + e x p (σ_{i}^{2}))

(1)

For calculating the aleotoric uncertainty loss, we perturb the logit value ( $y_{i}$ ) with Gaussian noise of variance $(σ_{a}^{2})_{i}$

(diagonal matrix with one element corrosponding to each logits value) before the softmax layer. The logits reparameterization trick

[26] and [16] combines

{^y}_{i, c}

and

σ_{i}

to give

N ({^y}_{i, c}, σ_{i}^{2})

. We then obtain a loss with respect to ground truth. It is expressed as:

{^y}_{i, c, t} = y_{i, c} + ϵ_{t} * σ_{i}^{2}, w h e r e ϵ_{t} \sim N (0, I)

(2)

L_{a} = \sum i log \frac{1}{T} \sum t exp ({^y}_{i, c, t} - log \sum c^{‘} exp {^y}_{i, c^{‘}, t})

(3)

where $L_{a}$ is the aleatoric uncertainty loss (AUL), T is the number of Monte Carlo simulations. $c^{^{'}}$

is a the class index of the logit vector

y_{i, t}

which is defined for all the classes.

3.2 Modeling Predictive Uncertainty

To obtain the model uncertainty, we measure epistemic uncertainty. However, estimating epistemic uncertainty[35]

is computationally expensive, and thus we measure the predictive uncertainty, having both aleatoric and epistemic uncertainties present in it. To estimate it, we sample weights in the Bayesian networks

G

and then perform Monte Carlo simulations over the model to obtain the predicted class probabilities

p (y_{i, t})

. That is,

\begin{matrix} O ({^y}_{i, t}) = G^{t} (x_{i}) v_{i, t}^{a} = S o f t p l u s (U^{t} ({^y}_{i, t})) p ({^y}_{i, c} | x_{i}, X_{I}) = (\frac{1}{T} T \sum t = 1 S o f t m a x O ({^y}_{i, t}))_{c} \end{matrix}

where c is the answer class, $G^{t} \sim G, U^{t} \sim U$ and $v_{i, t}^{a}$ is the aleatoric variance of each logit in the $t$ th MC Simulation. The entropy of the sampled logit’s probabilities can be calculated as:

H ({^y}_{i}) = - C \sum c = 1 p ({^y}_{i, c}) * log p ({^y}_{i, c})

(4)

The predictive uncertainty contains entropy and aleatoric variance when it’s expectation is taken across $T$ number of Monte Carlo simulations:

σ_{p}^{2} = H ({^y}_{i}) + \frac{1}{T} T \sum t = 1 v_{i, t}^{a}

(5)

where $H ({^y}_{i})$ is the entropy of the probability $p ({^y}_{i})$ , which depends on the spread of class probabilities while the variance (second term in the above equation) captures both the spread and the magnitude of logit outputs, ${^y}_{i, t}$ . In Equation 2, we can replace $σ_{a}^{2}$ with predictive uncertainty $σ_{p}^{2}$ (mentioned above in Equation 5) to get the predictive uncertainty loss (PUL).

Figure 3: Illustration of Uncertainty Loss

Figure 4: Illustration of model Gradient-based Certainty Attention Mask (GCA) and its certainty mask. We obtain image feature and question feature using CNN and LSTM, respectively. We then obtain attention mask using these features, and classification of the answer is done based on the attended feature.

4 Method

Task: We solve for VQA task. The key difference in our architecture as compared to the existing VQA models is the introduction of gradient-based certainty maps. A detailed figure of the model is given in the Figure 4. We keep other aspects of the VQA model unchanged. In a typical open-ended VQA task, we have a multi-class classification task. A combined (image and question) input embedding is fed to the model. Then, the output logits are fed to a softmax function, giving probabilities of the predictions in the multiple-choice answer space. That is, $^A = a r g m a x A \in Ω P (A | I, Q, θ)$ , where $Ω$ is a set of all possible answers, I is the image, Q is the corresponding question, and $θ$ is representing the parameters of the network.

4.1 U-CAM Approach

The three main parts of our method are Attention Representation, Uncertainties Estimation, and computing gradients of uncertainty losses. In the following sections, we explain them in detail.

4.1.1 Attention Representation

We obtain an embedding, $g_{i} \in R^{u \times v \times C}$ where u is width, v is height of the image and C represents the number of applied filters on the image $X_{i}$

in the convolution neural network (CNN). The CNN is parameterized by a function

G_{i} (X_{i}, θ_{i})

, where

θ_{i}

represents the weights. Similarly, for the query question

X_{Q}

, we obtain a question feature embedding

g_{q}

using a LSTM network. This network is parameterized by a function

G_{q} (X_{q}, θ_{q})

, where

θ_{q}

represents the weights. Both

g_{i}

and

g_{q}

are fed to an attention network that combines the image and question embeddings using a weighted softmax function and produces a weighted output attention vector,

g_{f}

as illustrated in Figure 4. People have tried with the various kinds of attention networks. In this paper, we tried with SAN [54] and MCB [15]. Finally, we obtain attention feature

f_{i}

using attention extractor network

G_{f} : f_{i} = G_{f} (g_{i}, g_{q})

. The attended feature

f_{i}

is passed through a classifier and the model is trained using the cross-entropy loss. Many a times, model is not certain about the answer class to which the input belongs, which sometimes leads to decrease in accuracy. To tackle this, we have proposed a technique to reduce the class uncertainty by increasing the certainty of the attention mask. Additionally, we also incorporate a loss based on the uncertainty which is described next.

4.1.2 Estimating Uncertainties: Aleatoric & Predictive

The attention feature, $f_{i}$ obtained from the previous step is fed to the classifier $G_{c}$ . The output of the classifier is fed to $G_{y}$ , which produces class probabilities, $y_{i}$ . $G_{c}$ ’s output is also fed to a variance predictor network, $G_{v}$ , which outputs the logits’ variance, $σ_{i}$ as mentioned in the Equation 1. For calculating the aleatoric uncertainty loss, we perturb the logit value ( $y_{i}$ ) with Gaussian noise of variance $(σ_{a}^{2})_{i}$ before the softmax layer. The Gaussian likelihood for classification is given by $p (y_{i} | f_{i}, w) = N (y_{i}; G_{y} (G_{c} (f_{i}; w)), τ^{- 1} (f_{i}; w))$ , where $w$ represents model’s parameters, $τ$ is the precision, $f_{i}$ is the attended fused input, and $G_{y} (G_{c} (.))$ is the output logit producing network as shown in the Figure 4 . The above setting represents the perturbation of model output with the variance of the observed noise, $τ^{- 1}$ . We make sure that $τ (.)$ is a positive or positive definite matrix (in case of Multivariate) by using the logit reparameterization trick [26] and [16]. Finally, we then obtain an aleatoric loss, $L_{a}$ with respect to ground truth as mentioned in the Equation 3. Our proposed model, which uses this loss as one of the components of its uncertainty loss, is called Aleatoric-GCA (A-GCA). Along with aleatoric loss $L_{a}$ , we combine $L_{V E}$ and $L_{U D L}$ as mentioned in the Equation 10 and 11 respectively to get total uncertainty loss $L_{u}$ . The classifier is trained by jointly minimizing both the classification loss, $L_{y}$ and the uncertainty loss, $L_{u}$ . In Equation 2, we can replace $σ_{a}^{2}$ with predictive uncertainty $σ_{p}^{2}$ (mentioned above in Equation 5) to get the predictive uncertainty loss(PUL). Accordingly, the model which uses this loss as one of the constituents of its uncertainty loss is called Predictive-GCA (P-GCA). Next, we compute the gradients of standard classification loss and uncertainty loss with respect to attended image feature, $f_{i}$ . Besides training, we also use these gradients to obtain visualizations describing important regions responsible for answer prediction, as mentioned in the qualitative analysis section. (Section 5.6)

4.1.3 Gradient Certainty Explanation for Attention

Uncertainty present in the attention maps often leads to uncertainty in the predictions and can be attributed to the noise in data and the uncertainty present in the model itself. We improve the certainty in these cases by adding the certainty gradients to the existing Standard Cross-Entropy (SCE) loss gradients for training the model during backpropagation.

Our objective is to improve the model’s attention in the regions where the classifier is more certain. The classifier will perform better by focusing more on certain attention regions, as those regions are more suited for the classification task. We can get an explanation for the classifier output as done in the existing Grad-CAM approach ( $\frac{\partial L_{y}}{\partial f_{i}}$ ). But that explanation does not take the model and data uncertainties into the account. We improve this explanation using the certainty gradients ( $- \frac{\partial L_{u}}{\partial f_{i}}$ ). If we can minimize uncertainty in the VQA explanation, then uncertainties in the image and question features, and thus uncertainties in the attention regions would be subsequently reduced. It is the uncertain regions which are a primary source for errors in the prediction, as shown in Figure 1.

In our proposed method, we compute the gradient of the Standard Classification (cross entropy) loss $L_{y}$ with respect to attention feature i.e. $\frac{\partial L_{y}}{\partial f_{i}}$ and and also the gradient of the uncertainty loss $L_{u}$ i.e. $\frac{\partial L_{u}}{\partial f_{i}}$ . The obtained uncertainty gradients are passed through a gradient reversal layer, giving us the certainty gradients, i.e., $- \frac{\partial L_{u}}{\partial f_{i}}$ .

\nabla_{y}^{^{'}} = - λ \frac{\partial L_{u}}{\partial f_{i}} * \frac{\partial L_{y}}{\partial f_{i}}

(6)

The positive sign of gradient $\nabla_{y}^{^{'}}$ indicates that the attention certainty is activated on these regions and vice-versa.

\nabla_{y}^{^{''}} = R e L U (\nabla_{y}^{^{'}}) + γ R e L U (- \nabla_{y}^{^{'}})

(7)

We apply a ReLU activation function on the product of gradients of the attention map and the gradients of certainty as we are only interested in attention regions that have a positive influence on interested answer class, i.e. attention regions whose intensity should be increased in order to increase answer class probability

y_{c}

, whereas negative values are multiplied by

γ

(large negative number) as the negative attention regions are likely to belong to other categories in image. As expected, without this ReLU, localization maps sometimes highlights more than just the desired class and achieves lower localization performance. Then we normalize

\nabla_{y}^{^{''}}

to get attention regions which are highly activated and giving more weight to certain regions.

\nabla_{y}^{^{'''}} = \frac{(\nabla_{y}^{^{''}})_{u, v}}{\sum_{u} \sum_{v} (\nabla_{y}^{^{''}})_{u v}}

(8)

Images with higher uncertainty are equivalent to having lower certainty, so the certain regions of these images should have lower attention values. We use residual gradient connection to obtain the final gradient, which is the sum of gradient mask of $L_{y}$ (with respect to attention feature) and the gradient certainty mask $\nabla_{y}^{^{'''}}$ and is given by:

\frac{\partial L_{y}}{\partial f_{i}} = \frac{\partial L_{y}}{\partial f_{i}} + \nabla_{y}^{^{'''}}

(9)

Where $\frac{\partial L_{y}}{\partial f_{i}}$ is the gradient mask of $L_{y}$ when gradients are taken with respect to attention feature. More details are given in the Algorithm 1.

1:procedure GCA(

I, Q

)

2: Input: Image

X_{I}

, Question

X_{Q}

3: Output: Answer

y_{c}

4: while loop do

5: Attention features

G_{f} (G_{i} (X_{I}), G_{q} (X_{Q})) \leftarrow f_{i}

6: Answer Logit

G_{y} (G_{c} (f_{i})) \leftarrow^y

7: Data Uncertainty

G_{v} (G_{c} (f_{i})) \leftarrow σ_{A}^{2}

8: if A-GCA then:

σ_{W}^{2} = σ_{A}^{2}

10: else if P-GCA then:

11:

σ2W=σ2A+H(^yi,t),(Ref: eq-~{}???)

12: end if

13: Ans cross entropy

L_{y} \leftarrow

loss

(^y, y)

14: Variance Equalizer

L_{V E} := \sum R e L U ({exp}^{σ_{w}^{2}} - {exp}^{I})

15: while

t = 1 : # M C - S a m p l e s

16: Sample

ϵ_{t}^{w} \sim N (0, σ_{W}^{2})

17: Distorted Logits:

{^y}_{i, t} = ϵ_{t}^{w} + {^y}_{i}

18: Gaussian Cross Entropy

L_{p} = - \sum y log p (_{d} | F (.))

19: Distorted Loss :

L_{U D L} = exp (L_{y} - L_{p})^{2}

20: Aleatoric uncertainty loss

L_{u} = L_{p} + L_{V E} + L_{U D L}

21: end while

22: Compute Gradients w.r.t

f_{i}

\nabla_{y} = \frac{\partial L_{y}}{\partial f_{i}}

\nabla_{u} = \frac{\partial L_{u}}{\partial f_{i}}

23: Certainty Gradients

\nabla_{u}^{^{'}} = - λ \nabla_{u} * \nabla_{y}

24: Certainty Activation

\nabla_{u}^{^{''}} = R e L U (\nabla_{u}^{^{'}}) + γ R e L U (- \nabla_{u}^{^{'}})

25: Final Certainty Gradients

\nabla_{u}^{^{'''}} = s o f t m a x (\nabla_{u}^{^{''}})

26: Final Attention Gradient

\nabla_{y} = \nabla_{y} + \nabla_{u}^{^{'''}}

27: update

θ_{f} \leftarrow θ_{f} - η \nabla_{y}

28: end while

29:end procedure

Algorithm 1 Gradient Certainty base Attention (GCA)

4.2 Cost Function

We estimate aleatoric uncertainty in logits space by perturbing each logit using the variance obtained from data. The uncertainty present in the logits value can be minimized using cross-entropy loss on Gaussian distorted logits, as shown in the Equation 3. The distorted logit is obtained using a Gaussian multivariate function, having positive diagonal variance. To stabilize the training process [16], we add an additional term to the uncertainty loss, calling it Variance Equalizer(VE) loss, $L_{V E}$ .

L_{V E} = exp (σ_{i}^{2}) - exp ({σ_{0}}^{2})

(10)

where $σ_{0}$ is a constant. The uncertainty distorted loss (UDL) is the difference between the typical cross-entropy loss and the aleatoric/predictive loss estimated in the Equation 3. The scalar difference is passed to an activation function to enhance the difference in either direction and is given by :

L_{U D L} = {\begin{matrix} α ({exp}^{[L_{p} - L_{y}]} - 1), & if [L_{p} - L_{y}] < 0 ., & otherwise . \end{matrix}

(11)

By putting this constraint, we ensure that the predictive uncertainty loss does not deviate much from the actual cross-entropy loss. The total uncertainty loss is the combination of Aleatoric (or prediction uncertainty loss), Uncertainty Distorted Loss, and Variance equalizer loss.

L_{u} = L_{p} + L_{V E} + L_{U D L}

(12)

The final cost function for the network combines the loss obtained through uncertainty (aleatoric or predictive) loss $L_{u}$ for the attention network with the cross-entropy.

The cost function used for obtaining the parameters $θ_{f}$ of the attention network, $θ_{c}$ of the classification network, $θ_{y}$ of the prediction network and $θ_{u}$ for uncertainty network is as follows:

C (θ_{f}, θ_{c}, θ_{y}, θ_{u}) = \frac{1}{n} n \sum j = 1 L_{y}^{j} (θ_{f}, θ_{c}, θ_{y}) + η L_{u}^{j} (θ_{f}, θ_{c}, θ_{u})

where n is the number of examples, and $η$ is the hyper-parameter which is fine-tuned using validation set, $L_{y}$ is standard cross-entropy loss and $L_{u}$ is the uncertainty loss. We train the model with this cost function until it converges so that the parameters. $({^θ}_{f}, {^θ}_{c}, {^θ}_{y}, {^θ}_{u})$ deliver a saddle point function

\begin{matrix} ({^θ}_{f}, {^θ}_{c}, {^θ}_{y}, {^θ}_{u}) = arg max θ_{f}, θ_{c}, θ_{y}, θ_{u} (C (θ_{f}, θ_{c}, θ_{y}, θ_{u})) \end{matrix}

(13)

5 Experiments

We evaluate the proposed GCA methods and have provided both quantitative analysis and qualitative analysis. The former includes: i) Ablation analysis of proposed models (Section- 5.2), ii) Analysis of uncertainty effect on answer predictions (Figure- 5 (a,b)), iii) Differences of Top-2 softmax scores for answers for some representative questions (Figure- 5 (c,d)) and iv) Comparison of attention map of our proposed uncertainty model against other variants using Rank correlation (RC) and Earth Mover Distance (EMD) [3] as shown in Table-3 for VQA-HAT [8] and in Table- 2 for VQA-X [20] . Finally, we compare PGCA with state of the art methods as mentioned in Section-5.4 . Qualitative analysis includes visualization of certainty activation maps for some representative images as we move from our basic model to the P-GCA model. (Section 5.6)

5.1 Datasets

VQA-v1 [2]: We conduct our experiments on VQA benchmark VQA-v1 [2] dataset, which contains human-annotated questions and answers based on images on MS-COCO dataset. This dataset includes 2,04,721 images in total, out of which 82,783 images are for training, 40,504 images for validation, and 81,434 images for testing. Each image is associated with three questions, and each question has ten possible answers. There are 248349 Question-Answer pairs for training, 121512 pairs for validation, and 244302 pairs for testing.

VQA-v2[19]: We provide benchmark result on VQA-v2[19] dataset. This dataset removes bias present in VQA-v1 by adding a conjugate image pair. It contains 443,757 image-question pairs on the training set, 214,354 pairs on the validation set and 447,793 pairs on the test set, which is more than twice the first version. All the questions and answers pairs are annotated by human annotators. The benchmark results on VQA-v2 dataset is presented in table-5.

VQA-HAT [8]: To compare our attention map with human-annotated attention maps, we use VQA-HAT [8] dataset. This dataset is developed for image de-blurring for answering the visual question. It contains 58475 human-annotated attention maps out of 248349 training examples and includes three sets of 1374 human-annotated attention maps out of 121512 validation examples of question image pairs in the validation dataset. This dataset is developed for VQA-v1 only.

Models	All	Yes/No	Number	Others
Baseline	63.8	82.2	37.3	54.2
VE	64.1	82.3	37.2	54.3
UDL	64.4	82.6	37.2	54.5
AUL	64.7	82.9	37.4	54.6
PUL	64.9	83.0	37.5	54.6
UDL+VE	64.8	82.8	37.4	54.5
AUL+VE	65.0	83.3	37.8	54.7
PUL+ VE	65.3	83.3	37.9	54.9
AUL +UDL	65.6	83.3	37.6	55.0
PUL + UDL	65.9	83.7	37.8	55.2
A-GCA (ours)	66.3	84.2	38.0	55.5
P-GCA (ours)	66.5	84.7	38.4	55.9

Table 1: Ablation analysis for Open-Ended VQA1.0 accuracy on test-dev

Model	RC( $↑$ )	EMD( $↓$ )
Baseline	0.3017	0.3825
Deconv ReLU	0.3198	0.3801
Guided GradCAM	0.3275	0.3781
Aleatoric mask	0.3571	0.3763
Predictive mask	0.3718	0.3714

Table 2: Rank Correlation for explanation mask in VQA-X [20] data with our explanation mask using Grad-Cam.

Figure 5: (a) Uncertainty vs Classification Error plots for our network for 20,000 randomly sampled images. We drew 25 samples of each image using Monte-Carlo sampling from the distribution. (b) Plots showing frequency of samples vs Uncertainty and frequency of samples vs Classification error respectively (c) Distance between the Top 2 Softmax scores for some Questions of type other than yes/no (d) Distance between the Top 2 Softmax scores for some Questions of type yes/no (Questions corresponding to (c) and (d) could be found in supplementary.)

5.2 Ablation Analysis for Uncertainty

Our proposed GCA model’s loss consists of undistorted and distorted loss. The undistorted loss is the Standard Cross-Entropy (SCE) loss. The distorted loss consists of uncertain loss (either aleatoric uncertainty loss (AUL), or predictive uncertainly loss (PUL)), Variance Equalizer (VE) loss and Uncertainty Distorted loss (UDL). In the first block of the Table- 1, we report the results when these losses are used individually. (Only SCE loss is there in the Baseline). We use a variant of the MCB [15] model as our baseline method. As seen, PUL, when used individually, outperforms the other 4. This could be attributed to PUL guiding the model to minimize both the data and the model uncertainty. The second block of the Table- 1 depicts the results when we tried while combining two different individual losses. The model variant, which is guided using the combination of PUL and UDL loss performs best among the five variants. Then finally, after combining (AUL+UDL+VE+SCE), denoting it as A-GCA model and combining (PUL+UDL+VE+SCE), indicating it as P-GCA, we report an improvement of around 2.5% and 2.7% accuracy score respectively.

Model	RC( $↑$ )	EMD( $↓$ )	CD( $↑$ )
SAN [8]	0.2432	0.4013	–
CoAtt-W[34]	0.246	–	–
CoAtt-P [34]	0.256	–	–
CoAtt-Q[34]	0.264	–	–
DVQA(K=1)[38]	0.328	–	–
Baseline (MCB)	0.2790	0.3931	–
VE (ours)	0.2832	0.3931	0.1013
UDL (ours)	0.2850	0.3914	0.1229
AUL (ours)	0.2937	0.3867	0.1502
PUL(ours)	0.3012	0.3805	0.1585
PUL + VE (ours)	0.3139	0.3851	0.1631
PUL + UDL(ours)	0.3243	0.3824	0.1630
A-GCA (ours)	0.3311	0.3784	0.1683
P-GCA (ours)	0.3341	0.3721	0.1710
Human [8]	0.623	–	–

Table 3: Ablation analysis and SOTA between HAT[8] attention and generated attention mask

Further, we plotted Predictive uncertainty (Figure- 5(a,b)) of some randomly chosen samples against the Classification error (error= $log \frac{1}{1 - p}$ , where p is the probability of misclassification). As seen, when the samples are correct, they are also certain and have less Classification Error (CE). To visualize the direct effect of decreased uncertainty, we plotted (Figure- 5(c, d)). It can be seen that how similar classes like (glasses, sunglasses) and (black, gray), etc., thus leading to uncertainty, got separated more in the logit space in the proposed model.

5.3 Analysis of Attention Maps

We compare attention maps produced by our proposed GCA model, and it’s variants with the base model and reports them in Table-3. Rank correlation and EMD score are calculated for the produced attention map against human-annotated attention (HAT) maps [8]. In the table, as we approach the best-proposed GCA model, Rank correlation (RC) is increasing. EMD is also decreasing (Lower the better) as we move towards GCA. To verify our intuition, that we can learn better attention mask by minimizing the uncertainty present in the attention mask, we start with VE and observe that both rank correlation and answer accuracy increase by 0.42 and 0.3 % from baseline respectively. We also observe that with UDL, AUL, and PUL based loss minimization technique, both RC and EMD improves, as shown in the Table- 3. Aleatoric-GCA (A-GCA) improves 5.21% in terms of RC and 2.5% in terms of accuracy. Finally, the proposed Predictive-GCA (P-GCA), which is modeled to consider both data and the model uncertainty improves the RC by 5.51% and accuracy by 2.7% as shown in the Table- 3 and Table- 1. Since HAT maps are only available for VQA-v1 dataset, thus, this ablation analysis has been performed only for VQA-v1. We also providing SOTA results for VQA-v1 and VQA-v2 dataset as shown in Table- 4 and Table- 5 respectively. Also, we compare with our gradient certainty explanation with human explanation present in VQA-v2 dataset for the various model as mentioned in Table- 2. This human explanation mask only available for VQA-v2 dataset. We observe that our attention (P-GCA) mask performs better than others as well.

Models	All	Y/N	Num	Oth
DPPnet [37]	57.2	80.7	37.2	41.7
SMem[[51]]	58.0	80.9	37.3	43.1
SAN [54]	58.7	79.3	36.6	46.1
DMN[50]	60.3	80.5	36.8	48.3
QRU(2)[33]	60.7	82.3	37.0	47.7
HieCoAtt [34]	61.8	79.7	38.9	51.7
MCB [15]	64.2	82.2	37.7	54.8
MLB [28]	65.0	84.0	37.9	54.7
DVQA[38]	65.4	83.8	38.1	55.2
P-GCA + SAN (ours)	60.4	80.7	36.6	47.9
A-GCA + MCB (ours)	66.3	84.2	38.0	55.5
P-GCA + MCB (ours)	66.5	84.6	38.4	55.9

Table 4: SOTA: Open-Ended VQA1.0 accuracy on test-dev

5.4 Comparison with baseline and state-of-the-art

We obtain the initial comparison with the baselines on the rank correlation on human attention (HAT) dataset [8] that provides human attention while solving for VQA. Between humans, the rank correlation is 62.3%. The comparison of various state-of-the-art methods and baselines are provided in Table 3. We use a variant of MCB [15] model as our baseline method. We obtain an improvement of around 5.2% using A-GCA model and 5.51% using P-GCA model in terms of rank correlation with human attention. From this, we justify that our attention map is more similar to human attention map. We also compare with the baselines on the answer accuracy on VQA-v1[2] dataset, as shown in Table- 4. We obtain an improvement of around 2.7% over the comparable MCB baseline. Our MCB based model A-GCA and P-GCA improves by 0.9% and 1.1% accuracy as compared to state of the art model DVQA [38] on VQA-v1. However, using a saliency-based method [22] that is trained on eye-tracking data to obtain a measure of where people look in a task-independent manner, results in more correlation with human attention (0.49), as noted by [8]. However, this is explicitly trained using human attention and is not task-dependent. In our approach, we aim to obtain a method that can simulate human cognitive abilities for solving the tasks. We provide state of the art results for VQA-v2 in Table- 5. This table shows that using GCA method, the VQA result improves. We have provided more results for attention map visualization for both types of uncertainty, training setup, dataset, and evaluation methods here.¹¹1https://delta-lab-iitk.github.io/U-CAM/ .

Models	All	Y/N	Num	Oth
SAN-2[54]	56.9	74.1	35.5	44.5
MCB [15]	64.0	78.8	38.3	53.3
Bottom[[1]]	65.3	81.8	44.2	56.0
DVQA[38]	65.9	82.4	43.2	56.8
MLB [28]	66.3	83.6	44.9	56.3
DA-NTN [4]	67.5	84.3	47.1	57.9
Counter[55]	68.0	83.1	51.6	58.9
BAN[27]	69.5	85.3	50.9	60.2
P-GCA + SAN (ours)	59.2	75.7	36.6	46.8
P-GCA + MCB (ours)	65.7	79.6	40.1	54.7
P-GCA + Counter (ours)	69.2	85.4	50.1	59.4

Table 5: SOTA: Open-Ended VQA2.0 accuracy on test-dev

5.5 Training and Model Configuration

We trained the P-GCA model using classification loss and uncertainty loss in an end-to-end manner. We have used ADAM optimizer to update the classification model parameter and configured hyper-parameter values using validation dataset as follows: {learning rate = 0.0001, batch size = 200, beta = 0.95, alpha = 0.99 and epsilon = 1e-8} to train the classification model. We have used SGD optimizer to update the uncertainty model parameter and configured hyper-parameter values using validation dataset as follows: {learning rate = 0.004, batch size = 200, and epsilon = 1e-8} to train the uncertainty model.

Figure 6: Examples with different approaches in each column for improving attention using explanation in a self-supervised manner. The first column indicates the given target image and its question and answer. Starting from the second column, it shows the activation map for baseline (MCB) Attention Network, Aleatoric (AUL), Predictive (PUL), A-GCA, P-GCA based approach respectively.

5.6 Qualitative Result

We provide attention map visualization of all models for 5 example images, as shown in Figure- 6. The first raw, the baseline model misclassifies the answer due to high uncertainty value, that gets resolved by our methods(P-GCA). We can see how attention is improved as we go from our baseline model (MCB) to the proposed Gradient Certainty model (P-GCA). For example, in the first row, MCB is unable to focus on any specific portion of the image, but as we go towards the right, it focuses the cup bottom, (indicated by intense orange color in the map). Same can be seen for other images also. We have visualized Grad-CAM maps to support our hypothesis that Grad-CAM is a very good way for visualizing what the network learns as it can focus on right portions of the image even in the baseline model (MCB), and therefore, can be used as a tutor to improve attention maps. For example, in MCB it tries to focus on the right portions but with the focus to other points as well. However, in our proposed model, visualization improves as the models focuses only on the required portion.

6 Conclusion

In this paper, we provide a method that uses gradient-based certainty attention regions to obtain improved visual question answering. The proposed method yields improved uncertainty estimates that are correspondingly more certain or uncertain, show consistent correlation with misclassification and are focused quantitatively on better attention regions as compared to other states of the art methods. The proposed architecture can be easily incorporated in various existing VQA methods as we show by incorporating the method in SAN [54] and MCB [15] models. The proposed technique could be used as a general means for obtaining improved uncertainty and explanation regions for various vision and language tasks, and in future, we aim to evaluate this further for other tasks such as ‘Visual Dialog’ and image captioning tasks.

References

[1] Peter Anderson, Xiaodong He, Chris Buehler, Damien Teney, Mark Johnson, Stephen Gould, and Lei Zhang. Bottom-up and top-down attention for image captioning and visual question answering. In
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
, pages 6077–6086, 2018.
[2] Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, and Devi Parikh. VQA: Visual Question Answering. In International Conference on Computer Vision (ICCV), 2015.
[3] Martin Arjovsky, Soumith Chintala, and Léon Bottou. Wasserstein gan. stat, 1050:26, 2017.
[4] Yalong Bai, Jianlong Fu, Tiejun Zhao, and Tao Mei.
Deep attention neural tensor network for visual question answering.
In Proceedings of the European Conference on Computer Vision (ECCV), pages 20–35, 2018.
[5] K Barnard, P Duygulu, and D Forsyth. N. de freitas, d. Blei, and MI Jordan,” Matching Words and Pictures”, submitted to JMLR, 2003.
[6] Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra. Weight uncertainty in neural network. In
International Conference on Machine Learning
, pages 1613–1622, 2015.
[7] Xinlei Chen and C Lawrence Zitnick. Mind’s eye: A recurrent visual representation for image caption generation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2422–2431, 2015.
[8] Abhishek Das, Harsh Agrawal, C. Lawrence Zitnick, Devi Parikh, and Dhruv Batra. Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions? In
Conference on Empirical Methods in Natural Language Processing (EMNLP)
, 2016.
[9] Abhishek Das, Satwik Kottur, José M.F. Moura, Stefan Lee, and Dhruv Batra.
Learning cooperative visual dialog agents with deep reinforcement learning.
In IEEE International Conference on Computer Vision (ICCV), 2017.
[10] Janez Demšar. Statistical comparisons of classifiers over multiple data sets. Journal of Machine learning research, 7(Jan):1–30, 2006.
[11] Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollár, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, et al. From captions to visual concepts and back. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2015.
[12] Ali Farhadi, Mohsen Hejrati, Mohammad Amin Sadeghi, Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth. Every picture tells a story: Generating sentences from images. In European conference on computer vision, pages 15–29. Springer, 2010.
[13] Darja Fišer, Tomaž Erjavec, and Nikola Ljubešić. Janes v0. 4: Korpus slovenskih spletnih uporabniških vsebin. Slovenščina, 2(4):2, 2016.
[14] Meire Fortunato, Charles Blundell, and Oriol Vinyals. Bayesian recurrent neural networks. arXiv preprint arXiv:1704.02798, 2017.
[15] Akira Fukui, Dong Huk Park, Daylen Yang, Anna Rohrbach, Trevor Darrell, and Marcus Rohrbach. Multimodal compact bilinear pooling for visual question answering and visual grounding. arXiv preprint arXiv:1606.01847, 2016.
[16] Yarin Gal. Uncertainty in Deep Learning. PhD thesis, University of Cambridge, 2016.
[17] Yarin Gal and Zoubin Ghahramani. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In International Conference on Machine Learning (ICML), pages 1050–1059, 2016.
[18] Yarin Gal and Zoubin Ghahramani.
A theoretically grounded application of dropout in recurrent neural networks.
In Advances in neural information processing systems, pages 1019–1027, 2016.
[19] Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh. Making the v in vqa matter: Elevating the role of image understanding in visual question answering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1–9, 2017.
[20] Dong Huk Park, Lisa Anne Hendricks, Zeynep Akata, Anna Rohrbach, Bernt Schiele, Trevor Darrell, and Marcus Rohrbach. Multimodal explanations: Justifying decisions and pointing to the evidence. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 8779–8788, 2018.
[21] Justin Johnson, Andrej Karpathy, and Li Fei-Fei.
Densecap: Fully convolutional localization networks for dense captioning.
In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4565–4574, 2016.
[22] Tilke Judd, Krista Ehinger, Frédo Durand, and Antonio Torralba. Learning to predict where humans look. In Computer Vision, 2009 IEEE 12th international conference on, pages 2106–2113. IEEE, 2009.
[23] Andrej Karpathy and Li Fei-Fei. Deep visual-semantic alignments for generating image descriptions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3128–3137, 2015.
[24] Alex Kendall, Vijay Badrinarayanan, and Roberto Cipolla. Bayesian segnet: Model uncertainty in deep convolutional encoder-decoder architectures for scene understanding. arXiv preprint arXiv:1511.02680, 2015.
[25] Alex Kendall and Yarin Gal. What uncertainties do we need in bayesian deep learning for computer vision? In Advances in neural information processing systems, pages 5574–5584, 2017.
[26] Alex Kendall, Yarin Gal, and Roberto Cipolla. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. 2018.
[27] Jin-Hwa Kim, Jaehyun Jun, and Byoung-Tak Zhang. Bilinear attention networks. In Advances in Neural Information Processing Systems, pages 1571–1581, 2018.
[28] Jin-Hwa Kim, Kyoung Woon On, Woosang Lim, Jeonghee Kim, Jung-Woo Ha, and Byoung-Tak Zhang. Hadamard Product for Low-rank Bilinear Pooling. In The 5th International Conference on Learning Representations, 2017.
[29] Girish Kulkarni, Visruth Premraj, Sagnik Dhar, Siming Li, Yejin Choi, Alexander C Berg, and Tamara L Berg. Baby talk: Understanding and generating image descriptions. In Proceedings of the 24th CVPR. Citeseer, 2011.
[30] Vinod Kumar Kurmi, Vipul Bajaj, Venkatesh K Subramanian, and Vinay P Namboodiri. Curriculum based dropout discriminator for domain adaptation. arXiv preprint arXiv:1907.10628, 2019.
[31] Vinod Kumar Kurmi, Shanu Kumar, and Vinay P Namboodiri. Attending to discriminative certainty for domain adaptation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 491–500, 2019.
[32] Vinod Kumar Kurmi and Vinay P Namboodiri. Looking back at labels: A class based domain adaptation technique. arXiv preprint arXiv:1904.01341, 2019.
[33] Ruiyu Li and Jiaya Jia. Visual question answering with question representation update (qru). In Advances in Neural Information Processing Systems, pages 4655–4663, 2016.
[34] Jiasen Lu, Jianwei Yang, Dhruv Batra, and Devi Parikh. Hierarchical question-image co-attention for visual question answering. In Advances In Neural Information Processing Systems, pages 289–297, 2016.
[35] Andrey Malinin and Mark Gales. Predictive uncertainty estimation via prior networks. In Advances in Neural Information Processing Systems, pages 7047–7058, 2018.
[36] Mateusz Malinowski and Mario Fritz. A multi-world approach to question answering about real-world scenes based on uncertain input. In Advances in Neural Information Processing Systems (NIPS), 2014.
[37] Hyeonwoo Noh, Paul Hongsuck Seo, and Bohyung Han. Image question answering using convolutional neural network with dynamic parameter prediction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 30–38, 2016.
[38] Badri Patro and Vinay P. Namboodiri. Differential attention for visual question answering. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018.
[39] Badri Narayana Patro, Sandeep Kumar, Vinod Kumar Kurmi, and Vinay Namboodiri. Multimodal differential network for visual question generation. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4002–4012. Association for Computational Linguistics, 2018.
[40] Badri Narayana Patro, Vinod Kumar Kurmi, Sandeep Kumar, and Vinay Namboodiri. Learning semantic sentence embeddings using sequential pair-wise discriminator. In Proceedings of the 27th International Conference on Computational Linguistics, pages 2715–2729, 2018.
[41] Mengye Ren, Ryan Kiros, and Richard Zemel. Exploring models and data for image question answering. In Advances in Neural Information Processing Systems (NIPS), pages 2953–2961, 2015.
[42] Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.
[43] Kevin J Shih, Saurabh Singh, and Derek Hoiem. Where to look: Focus regions for visual question answering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4613–4621, 2016.
[44] Pravendra Singh, Vinay Kumar Verma, Piyush Rai, and Vinay P. Namboodiri. Hetconv: Heterogeneous kernel-based convolutions for deep cnns. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
[45] Lewis Smith and Yarin Gal. Understanding measures of uncertainty for adversarial example detection. arXiv preprint arXiv:1803.08533, 2018.
[46] Richard Socher, Andrej Karpathy, Quoc V Le, Christopher D Manning, and Andrew Y Ng. Grounded compositional semantics for finding and describing images with sentences. Transactions of the Association of Computational Linguistics, 2(1):207–218, 2014.
[47] Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1):1929–1958, 2014.
[48] Mattias Teye, Hossein Azizpour, and Kevin Smith. Bayesian uncertainty estimation for batch normalized deep networks. arXiv preprint arXiv:1802.06455, 2018.
[49] Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. Show and tell: A neural image caption generator. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3156–3164, 2015.
[50] Caiming Xiong, Stephen Merity, and Richard Socher. Dynamic memory networks for visual and textual question answering. In Proceedings of International Conference on Machine Learning (ICML), 2016.
[51] Huijuan Xu and Kate Saenko. Ask, attend and answer: Exploring question-guided spatial attention for visual question answering. In European Conference on Computer Vision, pages 451–466. Springer, 2016.
[52] Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. Show, attend and tell: Neural image caption generation with visual attention. In International Conference on Machine Learning, pages 2048–2057, 2015.
[53] Xinchen Yan, Jimei Yang, Kihyuk Sohn, and Honglak Lee. Attribute2image: Conditional image generation from visual attributes. In European Conference on Computer Vision, pages 776–791. Springer, 2016.
[54] Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, and Alex Smola. Stacked attention networks for image question answering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 21–29, 2016.
[55] Yan Zhang, Jonathon Hare, and Adam Prügel-Bennett. Learning to count objects in natural images for visual question answering. 2018.
[56] Yuke Zhu, Oliver Groth, Michael Bernstein, and Li Fei-Fei. Visual7w: Grounded question answering in images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4995–5004, 2016.

7 Acknowledgment

We acknowledge the help provided by our Delta Lab members and our family who have supported us in our research activity.

8 supplementary

Table- 6 and - 7 shows list of the questions and its corresponding id’s in present in the figure-5

Question	ID
What does the person in this picture have on his face?	1
How many baby elephants are there?	2
What is in the bowl?	3
Is the television on or off?	4
What color is the walk light?	5
Which way is its head turned?	6
How many people are riding on each bike?	7
What animal is in this picture?	8
What color is the road?	9
What color is the boy’s hair?	10

Table 6: Reference for the Figure- 5(c).

Question	ID
Is this wheat bread?	1
Is the cat looking at the camera?	2
Is this chair broken?	3
Are these animals monitored?	4
Does the cat recognize someone?	5
Is the figurine life size?	6
Is the smaller dog on a leash?	7
Is this in the mountains?	8
Is the woman sitting on the bench?	9
Is the church empty?	10

Table 7: Reference for the Figure- 5(d).

U-CAM: Visual Explanation using Uncertainty based Class Activation Maps

Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA

Why do These Match? Explaining the Behavior of Image Similarity Models

Survey of Visual Question Answering: Datasets and Techniques

Extending Class Activation Mapping Using Gaussian Receptive Field

Differential Attention for Visual Question Answering

Improving Visual Grounding by Encouraging Consistent Gradient-based Explanations

GAM: Explainable Visual Similarity and Classification via Gradient Activation Maps

Code Repositories

U-CAM

1 Introduction

2 Related work

3 Modeling Uncertainty

3.1 Modeling Aleatoric Uncertainty

3.2 Modeling Predictive Uncertainty

4 Method

4.1 U-CAM Approach

4.1.1 Attention Representation

4.1.2 Estimating Uncertainties: Aleatoric & Predictive

4.1.3 Gradient Certainty Explanation for Attention

4.2 Cost Function

5 Experiments

5.1 Datasets

5.2 Ablation Analysis for Uncertainty

5.3 Analysis of Attention Maps

5.4 Comparison with baseline and state-of-the-art

5.5 Training and Model Configuration

5.6 Qualitative Result

6 Conclusion

References

7 Acknowledgment

8 supplementary

U-CAM: Visual Explanation using Uncertainty based Class Activation Maps

Related Research

Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA

Why do These Match? Explaining the Behavior of Image Similarity Models

Survey of Visual Question Answering: Datasets and Techniques

Extending Class Activation Mapping Using Gaussian Receptive Field

Differential Attention for Visual Question Answering

Improving Visual Grounding by Encouraging Consistent Gradient-based Explanations

GAM: Explainable Visual Similarity and Classification via Gradient Activation Maps

Code Repositories

U-CAM

1 Introduction

2 Related work

3 Modeling Uncertainty

3.1 Modeling Aleatoric Uncertainty

3.2 Modeling Predictive Uncertainty

4 Method

4.1 U-CAM Approach

4.1.1 Attention Representation

4.1.2 Estimating Uncertainties: Aleatoric & Predictive

4.1.3 Gradient Certainty Explanation for Attention

4.2 Cost Function

5 Experiments

5.1 Datasets

5.2 Ablation Analysis for Uncertainty

5.3 Analysis of Attention Maps

5.4 Comparison with baseline and state-of-the-art

5.5 Training and Model Configuration

5.6 Qualitative Result

6 Conclusion

References

7 Acknowledgment

8 supplementary