DeepAI AI Chat
Log In Sign Up

Unsupervised Instance Segmentation in Microscopy Images via Panoptic Domain Adaptation and Task Re-weighting

by   Dongnan Liu, et al.
The University of Sydney
Harvard University

Unsupervised domain adaptation (UDA) for nuclei instance segmentation is important for digital pathology, as it alleviates the burden of labor-intensive annotation and domain shift across datasets. In this work, we propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images, by learning from fluorescence microscopy images. More specifically, we first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images. Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation. Thirdly, in order to avoid the influence of the source-biased features, we propose a task re-weighting mechanism to dynamically add trade-off weights for the task-specific loss functions. Experimental results on three datasets indicate that our proposed method outperforms state-of-the-art UDA methods significantly, and demonstrates a similar performance as fully supervised methods.


page 1

page 4

page 7

page 8


Spatial Attention Pyramid Network for Unsupervised Domain Adaptation

Unsupervised domain adaptation is critical in various computer vision ta...

EDAPS: Enhanced Domain-Adaptive Panoptic Segmentation

With autonomous industries on the rise, domain adaptation of the visual ...

Unsupervised Domain Adaptation for Neuron Membrane Segmentation based on Structural Features

AI-enhanced segmentation of neuronal boundaries in electron microscopy (...

AnyStar: Domain randomized universal star-convex 3D instance segmentation

Star-convex shapes arise across bio-microscopy and radiology in the form...

Instance Segmentation of Dislocations in TEM Images

Quantitative Transmission Electron Microscopy (TEM) during in-situ strai...