Robust Interactive Semantic Segmentation of Pathology Images with Minimal User Input

08/30/2021
by   Mostafa Jahanifar, et al.
0

From the simple measurement of tissue attributes in pathology workflow to designing an explainable diagnostic/prognostic AI tool, access to accurate semantic segmentation of tissue regions in histology images is a prerequisite. However, delineating different tissue regions manually is a laborious, time-consuming and costly task that requires expert knowledge. On the other hand, the state-of-the-art automatic deep learning models for semantic segmentation require lots of annotated training data and there are only a limited number of tissue region annotated images publicly available. To obviate this issue in computational pathology projects and collect large-scale region annotations efficiently, we propose an efficient interactive segmentation network that requires minimum input from the user to accurately annotate different tissue types in the histology image. The user is only required to draw a simple squiggle inside each region of interest so it will be used as the guiding signal for the model. To deal with the complex appearance and amorph geometry of different tissue regions we introduce several automatic and minimalistic guiding signal generation techniques that help the model to become robust against the variation in the user input. By experimenting on a dataset of breast cancer images, we show that not only does our proposed method speed up the interactive annotation process, it can also outperform the existing automatic and interactive region segmentation models.

READ FULL TEXT

page 3

page 4

page 8

research
05/08/2023

Synthesis of Annotated Colorectal Cancer Tissue Images from Gland Layout

Generating annotated pairs of realistic tissue images along with their a...
research
04/08/2023

Region-Aware Portrait Retouching with Sparse Interactive Guidance

Portrait retouching aims to improve the aesthetic quality of input portr...
research
10/21/2022

Valuing Vicinity: Memory attention framework for context-based semantic segmentation in histopathology

The segmentation of histopathological whole slide images into tumourous ...
research
05/20/2021

Semantic segmentation of multispectral photoacoustic images using deep learning

Photoacoustic imaging has the potential to revolutionise healthcare due ...
research
07/14/2023

Adaptive Region Selection for Active Learning in Whole Slide Image Semantic Segmentation

The process of annotating histological gigapixel-sized whole slide image...
research
03/20/2023

NASDM: Nuclei-Aware Semantic Histopathology Image Generation Using Diffusion Models

In recent years, computational pathology has seen tremendous progress dr...
research
02/22/2022

An Object Aware Hybrid U-Net for Breast Tumour Annotation

In the clinical settings, during digital examination of histopathologica...

Please sign up or login with your details

Forgot password? Click here to reset