Exploring Visual Prompts for Whole Slide Image Classification with Multiple Instance Learning

03/23/2023
by   Yi Lin, et al.
0

Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). However, existing approaches typically rely on pre-trained models from large natural image datasets, such as ImageNet, to generate instance features, which can be sub-optimal due to the significant differences between natural images and histopathology images that lead to a domain shift. In this paper, we present a novel, simple yet effective method for learning domain-specific knowledge transformation from pre-trained models to histopathology images. Our approach entails using a prompt component to assist the pre-trained model in discerning differences between the pre-trained dataset and the target histopathology dataset, resulting in improved performance of MIL models. We validate our method on two publicly available datasets, Camelyon16 and TCGA-NSCLC. Extensive experimental results demonstrate the significant performance improvement of our method for different MIL models and backbones. Upon publication of this paper, we will release the source code for our method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2021

Pre-trained Models for Sonar Images

Machine learning and neural networks are now ubiquitous in sonar percept...
research
06/08/2023

Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models

The advent of large pre-trained models has brought about a paradigm shif...
research
02/20/2023

Domain-Specific Pretraining Improves Confidence in Whole Slide Image Classification

Whole Slide Images (WSIs) or histopathology images are used in digital p...
research
05/27/2023

FoPro-KD: Fourier Prompted Effective Knowledge Distillation for Long-Tailed Medical Image Recognition

Transfer learning is a promising technique for medical image classificat...
research
12/20/2022

Unleashing the Power of Visual Prompting At the Pixel Level

This paper presents a simple and effective visual prompting method for a...
research
01/27/2023

Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers

Since the recent advent of regulations for data protection (e.g., the Ge...
research
04/21/2023

RPLKG: Robust Prompt Learning with Knowledge Graph

Large-scale pre-trained models have been known that they are transferabl...

Please sign up or login with your details

Forgot password? Click here to reset