Distance-Aware eXplanation Based Learning

09/11/2023
by   Misgina Tsighe Hagos, et al.
0

eXplanation Based Learning (XBL) is an interactive learning approach that provides a transparent method of training deep learning models by interacting with their explanations. XBL augments loss functions to penalize a model based on deviation of its explanations from user annotation of image features. The literature on XBL mostly depends on the intersection of visual model explanations and image feature annotations. We present a method to add a distance-aware explanation loss to categorical losses that trains a learner to focus on important regions of a training dataset. Distance is an appropriate approach for calculating explanation loss since visual model explanations such as Gradient-weighted Class Activation Mapping (Grad-CAMs) are not strictly bounded as annotations and their intersections may not provide complete information on the deviation of a model's focus from relevant image regions. In addition to assessing our model using existing metrics, we propose an interpretability metric for evaluating visual feature-attribution based model explanations that is more informative of the model's performance than existing metrics. We demonstrate performance of our proposed method on three image classification tasks.

READ FULL TEXT

page 4

page 7

research
07/12/2023

Learning from Exemplary Explanations

eXplanation Based Learning (XBL) is a form of Interactive Machine Learni...
research
09/26/2022

Impact of Feedback Type on Explanatory Interactive Learning

Explanatory Interactive Learning (XIL) collects user feedback on visual ...
research
06/27/2022

RES: A Robust Framework for Guiding Visual Explanation

Despite the fast progress of explanation techniques in modern Deep Neura...
research
11/15/2022

Identifying Spurious Correlations and Correcting them with an Explanation-based Learning

Identifying spurious correlations learned by a trained model is at the c...
research
06/30/2022

Improving Visual Grounding by Encouraging Consistent Gradient-based Explanations

We propose a margin-based loss for vision-language model pretraining tha...
research
12/28/2020

Playing to distraction: towards a robust training of CNN classifiers through visual explanation techniques

The field of deep learning is evolving in different directions, with sti...
research
08/02/2023

Unlearning Spurious Correlations in Chest X-ray Classification

Medical image classification models are frequently trained using trainin...

Please sign up or login with your details

Forgot password? Click here to reset