Visual Feature Attribution using Wasserstein GANs

11/24/2017
by   Christian F. Baumgartner, et al.
0

Attributing the pixels of an input image to a certain category is an important and well-studied problem in computer vision, with applications ranging from weakly supervised localisation to understanding hidden effects in the data. In recent years, approaches based on interpreting a previously trained neural network classifier have become the de facto state-of-the-art and are commonly used on medical as well as natural image datasets. In this paper, we discuss a limitation of these approaches which may lead to only a subset of the category specific features being detected. To address this problem we develop a novel feature attribution technique based on Wasserstein Generative Adversarial Networks (WGAN), which does not suffer from this limitation. We show that our proposed method performs substantially better than the state-of-the-art for visual attribution on a synthetic dataset and on real 3D neuroimaging data from patients with mild cognitive impairment (MCI) and Alzheimer's disease (AD). For AD patients the method produces compellingly realistic disease effect maps which are very close to the observed effects.

READ FULL TEXT

page 1

page 4

page 6

page 8

page 12

page 13

page 14

research
05/06/2019

Source Generator Attribution via Inversion

With advances in Generative Adversarial Networks (GANs) leading to drama...
research
06/15/2021

Keep CALM and Improve Visual Feature Attribution

The class activation mapping, or CAM, has been the cornerstone of featur...
research
09/28/2021

Discriminative Attribution from Counterfactuals

We present a method for neural network interpretability by combining fea...
research
04/07/2021

Information Bottleneck Attribution for Visual Explanations of Diagnosis and Prognosis

Visual explanation methods have an important role in the prognosis of th...
research
08/29/2023

Multimodal Contrastive Learning and Tabular Attention for Automated Alzheimer's Disease Prediction

Alongside neuroimaging such as MRI scans and PET, Alzheimer's disease (A...
research
06/17/2021

Guided Integrated Gradients: An Adaptive Path Method for Removing Noise

Integrated Gradients (IG) is a commonly used feature attribution method ...
research
04/07/2020

Hierarchical Opacity Propagation for Image Matting

Natural image matting is a fundamental problem in computational photogra...

Please sign up or login with your details

Forgot password? Click here to reset