ContriMix: Unsupervised disentanglement of content and attribute for domain generalization in microscopy image analysis

06/07/2023
by   Tan H. Nguyen, et al.
0

Domain generalization is critical for real-world applications of machine learning models to microscopy images, including histopathology and fluorescence imaging. Artifacts in histopathology arise through a complex combination of factors relating to tissue collection and laboratory processing, as well as factors intrinsic to patient samples. In fluorescence imaging, these artifacts stem from variations across experimental batches. The complexity and subtlety of these artifacts make the enumeration of data domains intractable. Therefore, augmentation-based methods of domain generalization that require domain identifiers and manual fine-tuning are inadequate in this setting. To overcome this challenge, we introduce ContriMix, a domain generalization technique that learns to generate synthetic images by disentangling and permuting the biological content ("content") and technical variations ("attributes") in microscopy images. ContriMix does not rely on domain identifiers or handcrafted augmentations and makes no assumptions about the input characteristics of images. We assess the performance of ContriMix on two pathology datasets (Camelyon17-WILDS and a prostate cell classification dataset) and one fluorescence microscopy dataset (RxRx1-WILDS). ContriMix outperforms current state-of-the-art methods in all datasets, motivating its usage for microscopy image analysis in real-world settings where domain information is hard to come by.

READ FULL TEXT

page 4

page 7

page 14

page 15

page 16

research
05/22/2019

Separating Overlapping Tissue Layers from Microscopy Images

Manual preparation of tissue slices for microscopy imaging can introduce...
research
02/10/2018

Tubule segmentation of fluorescence microscopy images based on convolutional neural networks with inhomogeneity correction

Fluorescence microscopy has become a widely used tool for studying vario...
research
08/30/2016

New Methods to Improve Large-Scale Microscopy Image Analysis with Prior Knowledge and Uncertainty

Multidimensional imaging techniques provide powerful ways to examine var...
research
04/20/2023

Multi-domain learning CNN model for microscopy image classification

For any type of microscopy image, getting a deep learning model to work ...
research
07/26/2023

Phenotype-preserving metric design for high-content image reconstruction by generative inpainting

In the past decades, automated high-content microscopy demonstrated its ...
research
05/03/2023

Synthetic DOmain-Targeted Augmentation (S-DOTA) Improves Model Generalization in Digital Pathology

Machine learning algorithms have the potential to improve patient outcom...
research
12/06/2021

Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddings

Analyzing the morphology of cells in microscopy images can provide insig...

Please sign up or login with your details

Forgot password? Click here to reset