Finding a Needle in the Haystack: Attention-Based Classification of High Resolution Microscopy Images

11/20/2018
by   Naofumi Tomita, et al.
2

Deep learning for classification of microscopy images is challenging because whole-slide images are high resolution. Due to the large size of these images, they cannot be transferred into GPU memory, so there are currently no end-to-end deep learning architectures for their analysis. Existing work has used a sliding window for crop classification, followed by a heuristic to determine the label for the whole slide. This pipeline is not efficient or robust, however, because crops are analyzed independently of their neighbors and the decisive features for classifying a whole slide are only found in a few regions of interest. In this paper, we present an attention-based model for classification of high resolution microscopy images. Our model dynamically finds regions of interest from a wide-view, then identifies characteristic patterns in those regions for whole-slide classification. This approach is analogous to how pathologists examine slides under the microscope and is the first to generalize the attention mechanism to high resolution images. Furthermore, our model does not require bounding box annotations for the regions of interest and is trainable end-to-end with flexible input. We evaluated our model on a microscopy dataset of Barrett's Esophagus images, and the results showed that our approach outperforms the current state-of-the-art sliding window method by a large margin.

READ FULL TEXT

page 1

page 4

page 5

research
06/24/2018

Segmentation of Overlapped Steatosis in Whole-Slide Liver Histopathology Microscopy Images

An accurate steatosis quantification with pathology tissue samples is of...
research
07/15/2019

CA-RefineNet:A Dual Input WSI Image Segmentation Algorithm Based on Attention

Due to the high resolution of pathological images, the automated semanti...
research
05/03/2019

Processing Megapixel Images with Deep Attention-Sampling Models

Existing deep architectures cannot operate on very large signals such as...
research
01/11/2023

Fast spline detection in high density microscopy data

Computer-aided analysis of biological microscopy data has seen a massive...
research
06/05/2021

An End-to-End Breast Tumour Classification Model Using Context-Based Patch Modelling- A BiLSTM Approach for Image Classification

Researchers working on computational analysis of Whole Slide Images (WSI...
research
11/14/2019

Detecting cutaneous basal cell carcinomas in ultra-high resolution and weakly labelled histopathological images

Diagnosing basal cell carcinomas (BCC), one of the most common cutaneous...
research
04/07/2021

Differentiable Patch Selection for Image Recognition

Neural Networks require large amounts of memory and compute to process h...

Please sign up or login with your details

Forgot password? Click here to reset