NuClick: A Deep Learning Framework for Interactive Segmentation of Microscopy Images

05/29/2020
by   Navid Alemi Koohbanani, et al.
8

Object Segmentation is an important step in the work-flow of computational pathology. Deep learning based models as the best forming models require huge amount of labeled data for precise and reliable prediction. However, collecting labeled data is expensive, because it necessarily involves expert knowledge. This is perhaps best illustrated by medical tasks where measurements call for expensive machinery and labels are the fruit of a time-consuming analysis that draws from multiple human experts. As nuclei, cells and glands are fundamental objects for downstream analysis in histology, in this paper we propose a simple CNN-based approach to speed up collecting segmentation annotation for these objects by utilizing minimum input from an annotator. We show for nuclei and cells as small objects, one click inside objects is enough to have precise annotation. For glands as large objects, providing a squiggle to show the extend of gland can guide the model to outline the exact boundaries. This supervisory signals are fed to network as an auxiliary channels along with RGB channels. With detailed experiments, we show that our approach is generalizable, robust against variations in the user input and that it can be used to obtain annotations for completely different domains. Practically, a model trained on the masks generated by NuClick could achieve first rank in LYON19 challenge. Furthermore, as the output of our framework, we release two data-sets: 1) a dataset of lymphocyte annotations within IHC images and 2) a dataset of WBCs annotated in blood sample images.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 9

page 12

page 13

research
09/07/2019

NuClick: From Clicks in the Nuclei to Nuclear Boundaries

Best performing nuclear segmentation methods are based on deep learning ...
research
01/14/2019

Iterative Deep Learning Based Unbiased Stereology With Human-in-the-Loop

Lack of enough labeled data is a major problem in building machine learn...
research
07/09/2023

Mitosis Detection from Partial Annotation by Dataset Generation via Frame-Order Flipping

Detection of mitosis events plays an important role in biomedical resear...
research
09/25/2020

Going to Extremes: Weakly Supervised Medical Image Segmentation

Medical image annotation is a major hurdle for developing precise and ro...
research
04/22/2018

Micro-Net: A unified model for segmentation of various objects in microscopy images

Object segmentation and structure localization are important steps in au...
research
03/26/2018

Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++

Manually labeling datasets with object masks is extremely time consuming...
research
08/31/2023

Domain Adaptive Synapse Detection with Weak Point Annotations

The development of learning-based methods has greatly improved the detec...

Please sign up or login with your details

Forgot password? Click here to reset