Active Globally Explainable Learning for Medical Images via Class Association Embedding and Cyclic Adversarial Generation

06/12/2023
by   Ruitao Xie, et al.
0

Explainability poses a major challenge to artificial intelligence (AI) techniques. Current studies on explainable AI (XAI) lack the efficiency of extracting global knowledge about the learning task, thus suffer deficiencies such as imprecise saliency, context-aware absence and vague meaning. In this paper, we propose the class association embedding (CAE) approach to address these issues. We employ an encoder-decoder architecture to embed sample features and separate them into class-related and individual-related style vectors simultaneously. Recombining the individual-style code of a given sample with the class-style code of another leads to a synthetic sample with preserved individual characters but changed class assignment, following a cyclic adversarial learning strategy. Class association embedding distills the global class-related features of all instances into a unified domain with well separation between classes. The transition rules between different classes can be then extracted and further employed to individual instances. We then propose an active XAI framework which manipulates the class-style vector of a certain sample along guided paths towards the counter-classes, resulting in a series of counter-example synthetic samples with identical individual characters. Comparing these counterfactual samples with the original ones provides a global, intuitive illustration to the nature of the classification tasks. We adopt the framework on medical image classification tasks, which show that more precise saliency maps with powerful context-aware representation can be achieved compared with existing methods. Moreover, the disease pathology can be directly visualized via traversing the paths in the class-style space.

READ FULL TEXT
research
08/29/2023

ARTxAI: Explainable Artificial Intelligence Curates Deep Representation Learning for Artistic Images using Fuzzy Techniques

Automatic art analysis employs different image processing techniques to ...
research
12/18/2019

Class Regularization: Improve Few-shot Image Classification by Reducing Meta Shift

Few-shot image classification requires the classifier to robustly cope w...
research
05/29/2019

GlyphGAN: Style-Consistent Font Generation Based on Generative Adversarial Networks

In this paper, we propose GlyphGAN: style-consistent font generation bas...
research
04/04/2022

Generalized Zero Shot Learning For Medical Image Classification

In many real world medical image classification settings we do not have ...
research
10/10/2022

Association Graph Learning for Multi-Task Classification with Category Shifts

In this paper, we focus on multi-task classification, where related clas...
research
09/16/2021

Transductive Learning for Unsupervised Text Style Transfer

Unsupervised style transfer models are mainly based on an inductive lear...
research
11/29/2022

ExpNet: A unified network for Expert-Level Classification

Different from the general visual classification, some classification ta...

Please sign up or login with your details

Forgot password? Click here to reset