Differentiable Zooming for Multiple Instance Learning on Whole-Slide Images

04/26/2022
by   Kevin Thandiackal, et al.
0

Multiple Instance Learning (MIL) methods have become increasingly popular for classifying giga-pixel sized Whole-Slide Images (WSIs) in digital pathology. Most MIL methods operate at a single WSI magnification, by processing all the tissue patches. Such a formulation induces high computational requirements, and constrains the contextualization of the WSI-level representation to a single scale. A few MIL methods extend to multiple scales, but are computationally more demanding. In this paper, inspired by the pathological diagnostic process, we propose ZoomMIL, a method that learns to perform multi-level zooming in an end-to-end manner. ZoomMIL builds WSI representations by aggregating tissue-context information from multiple magnifications. The proposed method outperforms the state-of-the-art MIL methods in WSI classification on two large datasets, while significantly reducing the computational demands with regard to Floating-Point Operations (FLOPs) and processing time by up to 40x.

READ FULL TEXT

page 10

page 14

page 17

page 18

research
03/01/2023

AMIGO: Sparse Multi-Modal Graph Transformer with Shared-Context Processing for Representation Learning of Giga-pixel Images

Processing giga-pixel whole slide histopathology images (WSI) is a compu...
research
05/06/2021

Sparse convolutional context-aware multiple instance learning for whole slide image classification

Whole slide microscopic slides display many cues about the underlying ti...
research
11/22/2016

Learning Multi-level Deep Representations for Image Emotion Classification

In this paper, we propose a new deep network that learns multi-level dee...
research
11/30/2019

Supervised and Unsupervised End-to-End Deep Learning for Gene Ontology Classification of Neural In Situ Hybridization Images

In recent years, large datasets of high-resolution mammalian neural imag...
research
12/11/2020

Classifying Breast Histopathology Images with a Ductal Instance-Oriented Pipeline

In this study, we propose the Ductal Instance-Oriented Pipeline (DIOP) t...
research
06/29/2020

Multi-level colonoscopy malignant tissue detection with adversarial CAC-UNet

The automatic and objective medical diagnostic model can be valuable to ...
research
11/14/2017

pyLEMMINGS: Large Margin Multiple Instance Classification and Ranking for Bioinformatics Applications

Motivation: A major challenge in the development of machine learning bas...

Please sign up or login with your details

Forgot password? Click here to reset