Region-guided CycleGANs for Stain Transfer in Whole Slide Images

08/26/2022
by   Joseph Boyd, et al.
17

In whole slide imaging, commonly used staining techniques based on hematoxylin and eosin (H E) and immunohistochemistry (IHC) stains accentuate different aspects of the tissue landscape. In the case of detecting metastases, IHC provides a distinct readout that is readily interpretable by pathologists. IHC, however, is a more expensive approach and not available at all medical centers. Virtually generating IHC images from H E using deep neural networks thus becomes an attractive alternative. Deep generative models such as CycleGANs learn a semantically-consistent mapping between two image domains, while emulating the textural properties of each domain. They are therefore a suitable choice for stain transfer applications. However, they remain fully unsupervised, and possess no mechanism for enforcing biological consistency in stain transfer. In this paper, we propose an extension to CycleGANs in the form of a region of interest discriminator. This allows the CycleGAN to learn from unpaired datasets where, in addition, there is a partial annotation of objects for which one wishes to enforce consistency. We present a use case on whole slide images, where an IHC stain provides an experimentally generated signal for metastatic cells. We demonstrate the superiority of our approach over prior art in stain transfer on histopathology tiles over two datasets. Our code and model are available at https://github.com/jcboyd/miccai2022-roigan.

READ FULL TEXT
research
12/21/2020

Building LEGO Using Deep Generative Models of Graphs

Generative models are now used to create a variety of high-quality digit...
research
09/05/2023

An Efficient Approach to Unsupervised Out-of-Distribution Detection with Variational Autoencoders

This paper is concerned with deep generative models (DGMs) for unsupervi...
research
05/28/2021

Measuring global properties of neural generative model outputs via generating mathematical objects

We train deep generative models on datasets of reflexive polytopes. This...
research
07/14/2021

Mutually improved endoscopic image synthesis and landmark detection in unpaired image-to-image translation

The CycleGAN framework allows for unsupervised image-to-image translatio...
research
08/17/2021

Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfer

With the strength of deep generative models, 3D pose transfer regains in...
research
04/19/2022

Dual-Domain Image Synthesis using Segmentation-Guided GAN

We introduce a segmentation-guided approach to synthesise images that in...
research
08/03/2022

DALLE-URBAN: Capturing the urban design expertise of large text to image transformers

Automatically converting text descriptions into images using transformer...

Please sign up or login with your details

Forgot password? Click here to reset