RCNN-SliceNet: A Slice and Cluster Approach for Nuclei Centroid Detection in Three-Dimensional Fluorescence Microscopy Images

by   Liming Wu, et al.

Robust and accurate nuclei centroid detection is important for the understanding of biological structures in fluorescence microscopy images. Existing automated nuclei localization methods face three main challenges: (1) Most of object detection methods work only on 2D images and are difficult to extend to 3D volumes; (2) Segmentation-based models can be used on 3D volumes but it is computational expensive for large microscopy volumes and they have difficulty distinguishing different instances of objects; (3) Hand annotated ground truth is limited for 3D microscopy volumes. To address these issues, we present a scalable approach for nuclei centroid detection of 3D microscopy volumes. We describe the RCNN-SliceNet to detect 2D nuclei centroids for each slice of the volume from different directions and 3D agglomerative hierarchical clustering (AHC) is used to estimate the 3D centroids of nuclei in a volume. The model was trained with the synthetic microscopy data generated using Spatially Constrained Cycle-Consistent Adversarial Networks (SpCycleGAN) and tested on different types of real 3D microscopy data. Extensive experimental results demonstrate that our proposed method can accurately count and detect the nuclei centroids in a 3D microscopy volume.



There are no comments yet.


page 3

page 6

page 8


Center-Extraction-Based Three Dimensional Nuclei Instance Segmentation of Fluorescence Microscopy Images

Fluorescence microscopy is an essential tool for the analysis of 3D subc...

Microtubule Tracking in Electron Microscopy Volumes

We present a method for microtubule tracking in electron microscopy volu...

Ultrafast Focus Detection for Automated Microscopy

Recent advances in scientific instruments have resulted in dramatic incr...

Three dimensional blind image deconvolution for fluorescence microscopy using generative adversarial networks

Due to image blurring image deconvolution is often used for studying bio...

Spatial-Temporal Mitosis Detection in Phase-Contrast Microscopy via Likelihood Map Estimation by 3DCNN

Automated mitotic detection in time-lapse phasecontrast microscopy provi...

Inverse Multislice Ptychography by Layer-wise Optimisation and Sparse Matrix Decomposition

We propose algorithms based on an optimisation method for inverse multis...

NeuRegenerate: A Framework for Visualizing Neurodegeneration

Recent advances in high-resolution microscopy have allowed scientists to...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.