Underwhelming Generalization Improvements From Controlling Feature Attribution

10/01/2019
by   Joseph D. Viviano, et al.
viviano.ca
25

Overfitting is a common issue in machine learning, which can arise when the model learns to predict class membership using convenient but spuriously-correlated image features instead of the true image features that denote a class. These are typically visualized using saliency maps. In some object classification tasks such as for medical images, one may have some images with masks, indicating a region of interest, i.e., which part of the image contains the most relevant information for the classification. We describe a simple method for taking advantage of such auxiliary labels, by training networks to ignore the distracting features which may be extracted outside of the region of interest, on the training images for which such masks are available. This mask information is only used during training and has an impact on generalization accuracy in a dataset-dependent way. We observe an underwhelming relationship between controlling saliency maps and improving generalization performance.

READ FULL TEXT

page 2

page 3

page 5

page 7

page 8

page 13

page 14

10/19/2020

Investigating and Simplifying Masking-based Saliency Methods for Model Interpretability

Saliency maps that identify the most informative regions of an image for...
01/12/2023

Hierarchical Dynamic Masks for Visual Explanation of Neural Networks

Saliency methods generating visual explanatory maps representing the imp...
10/16/2019

Global Saliency: Aggregating Saliency Maps to Assess Dataset Artefact Bias

In high-stakes applications of machine learning models, interpretability...
06/29/2023

GuidedMixup: An Efficient Mixup Strategy Guided by Saliency Maps

Data augmentation is now an essential part of the image training process...
04/16/2019

GradMask: Reduce Overfitting by Regularizing Saliency

With too few samples or too many model parameters, overfitting can inhib...
10/19/2019

NormGrad: Finding the Pixels that Matter for Training

The different families of saliency methods, either based on contrastive ...

Please sign up or login with your details

Forgot password? Click here to reset