Structure-Preserving Multi-Domain Stain Color Augmentation using Style-Transfer with Disentangled Representations

07/26/2021
by   Sophia J. Wagner, et al.
0

In digital pathology, different staining procedures and scanners cause substantial color variations in whole-slide images (WSIs), especially across different laboratories. These color shifts result in a poor generalization of deep learning-based methods from the training domain to external pathology data. To increase test performance, stain normalization techniques are used to reduce the variance between training and test domain. Alternatively, color augmentation can be applied during training leading to a more robust model without the extra step of color normalization at test time. We propose a novel color augmentation technique, HistAuGAN, that can simulate a wide variety of realistic histology stain colors, thus making neural networks stain-invariant when applied during training. Based on a generative adversarial network (GAN) for image-to-image translation, our model disentangles the content of the image, i.e., the morphological tissue structure, from the stain color attributes. It can be trained on multiple domains and, therefore, learns to cover different stain colors as well as other domain-specific variations introduced in the slide preparation and imaging process. We demonstrate that HistAuGAN outperforms conventional color augmentation techniques on a classification task on the publicly available dataset Camelyon17 and show that it is able to mitigate present batch effects.

READ FULL TEXT
research
02/18/2019

Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology

Stain variation is a phenomenon observed when distinct pathology laborat...
research
06/20/2022

Test-time image-to-image translation ensembling improves out-of-distribution generalization in histopathology

Histopathology whole slide images (WSIs) can reveal significant inter-ho...
research
07/04/2023

Augment Features Beyond Color for Domain Generalized Segmentation

Domain generalized semantic segmentation (DGSS) is an essential but high...
research
01/09/2023

Nuclear Segmentation and Classification: On Color Compression Generalization

Since the introduction of digital and computational pathology as a field...
research
05/03/2023

Synthetic DOmain-Targeted Augmentation (S-DOTA) Improves Model Generalization in Digital Pathology

Machine learning algorithms have the potential to improve patient outcom...
research
08/14/2017

Context-based Normalization of Histological Stains using Deep Convolutional Features

While human observers are able to cope with variations in color and appe...
research
03/28/2016

Colorful Image Colorization

Given a grayscale photograph as input, this paper attacks the problem of...

Please sign up or login with your details

Forgot password? Click here to reset