DeepAI AI Chat
Log In Sign Up

3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images

by   Sungmin Hong, et al.

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However, current GAN technologies for 3D medical image synthesis need to be significantly improved to be readily adapted to real-world medical problems. In this paper, we extend the state-of-the-art StyleGAN2 model, which natively works with two-dimensional images, to enable 3D image synthesis. In addition to the image synthesis, we investigate the controllability and interpretability of the 3D-StyleGAN via style vectors inherited form the original StyleGAN2 that are highly suitable for medical applications: (i) the latent space projection and reconstruction of unseen real images, and (ii) style mixing. We demonstrate the 3D-StyleGAN's performance and feasibility with  12,000 three-dimensional full brain MR T1 images, although it can be applied to any 3D volumetric images. Furthermore, we explore different configurations of hyperparameters to investigate potential improvement of the image synthesis with larger networks. The codes and pre-trained networks are available online:


page 6

page 7

page 8

page 9


Medical Image Generation using Generative Adversarial Networks

Generative adversarial networks (GANs) are unsupervised Deep Learning ap...

Explicit Temporal Embedding in Deep Generative Latent Models for Longitudinal Medical Image Synthesis

Medical imaging plays a vital role in modern diagnostics and treatment. ...

Bidirectional Mapping Generative Adversarial Networks for Brain MR to PET Synthesis

Fusing multi-modality medical images, such as MR and PET, can provide va...

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

In this paper, we propose a bi-modality medical image synthesis approach...

Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Images

The generation of three-dimensional (3D) medical images can have great a...

Microstructure synthesis using style-based generative adversarial network

Work considers the usage of StyleGAN architecture for the task of micros...