A Multi-attribute Controllable Generative Model for Histopathology Image Synthesis

11/10/2021
by   Jiarong Ye, et al.
0

Generative models have been applied in the medical imaging domain for various image recognition and synthesis tasks. However, a more controllable and interpretable image synthesis model is still lacking yet necessary for important applications such as assisting in medical training. In this work, we leverage the efficient self-attention and contrastive learning modules and build upon state-of-the-art generative adversarial networks (GANs) to achieve an attribute-aware image synthesis model, termed AttributeGAN, which can generate high-quality histopathology images based on multi-attribute inputs. In comparison to existing single-attribute conditional generative models, our proposed model better reflects input attributes and enables smoother interpolation among attribute values. We conduct experiments on a histopathology dataset containing stained H E images of urothelial carcinoma and demonstrate the effectiveness of our proposed model via comprehensive quantitative and qualitative comparisons with state-of-the-art models as well as different variants of our model. Code is available at https://github.com/karenyyy/MICCAI2021AttributeGAN.

READ FULL TEXT

page 6

page 7

research
07/12/2022

SD-GAN: Semantic Decomposition for Face Image Synthesis with Discrete Attribute

Manipulating latent code in generative adversarial networks (GANs) for f...
research
10/12/2022

3D Brain and Heart Volume Generative Models: A Survey

Generative models such as generative adversarial networks and autoencode...
research
06/09/2023

Illumination Controllable Dehazing Network based on Unsupervised Retinex Embedding

On the one hand, the dehazing task is an illposedness problem, which mea...
research
08/26/2022

Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generation

3D-aware GANs based on generative neural radiance fields (GNeRF) have ac...
research
11/11/2018

An Interpretable Generative Model for Handwritten Digit Image Synthesis

An interpretable generative model for handwritten digits synthesis is pr...
research
02/16/2023

3D-aware Conditional Image Synthesis

We propose pix2pix3D, a 3D-aware conditional generative model for contro...
research
03/27/2020

Controllable Person Image Synthesis with Attribute-Decomposed GAN

This paper introduces the Attribute-Decomposed GAN, a novel generative m...

Please sign up or login with your details

Forgot password? Click here to reset