Medical Diffusion – Denoising Diffusion Probabilistic Models for 3D Medical Image Generation

11/07/2022
by   Firas Khader, et al.
0

Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models in particular have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen and Stable Diffusion. However, their use in medicine, where image data typically comprises three-dimensional volumes, has not been systematically evaluated. Synthetic images may play a crucial role in privacy preserving artificial intelligence and can also be used to augment small datasets. Here we show that diffusion probabilistic models can synthesize high quality medical imaging data, which we show for Magnetic Resonance Images (MRI) and Computed Tomography (CT) images. We provide quantitative measurements of their performance through a reader study with two medical experts who rated the quality of the synthesized images in three categories: Realistic image appearance, anatomical correctness and consistency between slices. Furthermore, we demonstrate that synthetic images can be used in a self-supervised pre-training and improve the performance of breast segmentation models when data is scarce (dice score 0.91 vs. 0.95 without vs. with synthetic data).

READ FULL TEXT

page 19

page 21

page 22

page 23

research
09/15/2022

Brain Imaging Generation with Latent Diffusion Models

Deep neural networks have brought remarkable breakthroughs in medical im...
research
07/03/2023

Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesis

Generative latent diffusion models have been established as state-of-the...
research
05/12/2023

Beware of diffusion models for synthesizing medical images – A comparison with GANs in terms of memorizing brain tumor images

Diffusion models were initially developed for text-to-image generation a...
research
11/02/2022

Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models

Generative models are becoming popular for the synthesis of medical imag...
research
12/16/2022

SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generation

Human organs constantly undergo anatomical changes due to a complex mix ...
research
06/27/2022

Diffusion Deformable Model for 4D Temporal Medical Image Generation

Temporal volume images with 3D+t (4D) information are often used in medi...

Please sign up or login with your details

Forgot password? Click here to reset