From slides (through tiles) to pixels: an explainability framework for weakly supervised models in pre-clinical pathology

02/03/2023
by   Marco Bertolini, et al.
0

In pre-clinical pathology, there is a paradox between the abundance of raw data (whole slide images from many organs of many individual animals) and the lack of pixel-level slide annotations done by pathologists. Due to time constraints and requirements from regulatory authorities, diagnoses are instead stored as slide labels. Weakly supervised training is designed to take advantage of those data, and the trained models can be used by pathologists to rank slides by their probability of containing a given lesion of interest. In this work, we propose a novel contextualized eXplainable AI (XAI) framework and its application to deep learning models trained on Whole Slide Images (WSIs) in Digital Pathology. Specifically, we apply our methods to a multi-instance-learning (MIL) model, which is trained solely on slide-level labels, without the need for pixel-level annotations. We validate quantitatively our methods by quantifying the agreements of our explanations' heatmaps with pathologists' annotations, as well as with predictions from a segmentation model trained on such annotations. We demonstrate the stability of the explanations with respect to input shifts, and the fidelity with respect to increased model performance. We quantitatively evaluate the correlation between available pixel-wise annotations and explainability heatmaps. We show that the explanations on important tiles of the whole slide correlate with tissue changes between healthy regions and lesions, but do not exactly behave like a human annotator. This result is coherent with the model training strategy.

READ FULL TEXT

page 5

page 7

page 8

page 12

page 14

research
02/01/2018

Classification and Disease Localization in Histopathology Using Only Global Labels: A Weakly-Supervised Approach

Analysis of histopathology slides is a critical step for many diagnoses,...
research
11/05/2019

Weakly Supervised Fine Tuning Approach for Brain Tumor Segmentation Problem

Segmentation of tumors in brain MRI images is a challenging task, where ...
research
03/15/2023

Pixel-Level Explanation of Multiple Instance Learning Models in Biomedical Single Cell Images

Explainability is a key requirement for computer-aided diagnosis systems...
research
08/14/2018

Vendor-independent soft tissue lesion detection using weakly supervised and unsupervised adversarial domain adaptation

Computer-aided detection aims to improve breast cancer screening program...
research
07/21/2023

PourIt!: Weakly-supervised Liquid Perception from a Single Image for Visual Closed-Loop Robotic Pouring

Liquid perception is critical for robotic pouring tasks. It usually requ...
research
07/29/2022

Weakly Supervised Deep Instance Nuclei Detection using Points Annotation in 3D Cardiovascular Immunofluorescent Images

Two major causes of death in the United States and worldwide are stroke ...
research
09/18/2021

Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy Logic

Natural language inference (NLI) aims to determine the logical relations...

Please sign up or login with your details

Forgot password? Click here to reset