Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report

10/21/2022
by   Pouria Rouzrokh, et al.
42

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that might be freely shared without compromising patient privacy is a well-known technique for addressing these difficulties. Inpainting algorithms are a subset of DL generative models that can alter one or more regions of an input image while matching its surrounding context and, in certain cases, non-imaging input conditions. Although the majority of inpainting techniques for medical imaging data use generative adversarial networks (GANs), the performance of these algorithms is frequently suboptimal due to their limited output variety, a problem that is already well-known for GANs. Denoising diffusion probabilistic models (DDPMs) are a recently introduced family of generative networks that can generate results of comparable quality to GANs, but with diverse outputs. In this paper, we describe a DDPM to execute multiple inpainting tasks on 2D axial slices of brain MRI with various sequences, and present proof-of-concept examples of its performance in a variety of evaluation scenarios. Our model and a public online interface to try our tool are available at: https://github.com/Mayo-Radiology-Informatics-Lab/MBTI

READ FULL TEXT

page 2

page 4

page 5

page 9

page 10

page 11

page 14

research
12/04/2022

Brain Tumor Synthetic Data Generation with Adaptive StyleGANs

Generative models have been very successful over the years and have rece...
research
07/26/2018

Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks

Data diversity is critical to success when training deep learning models...
research
10/13/2022

Two approaches to inpainting microstructure with deep convolutional generative adversarial networks

Imaging is critical to the characterisation of materials. However, even ...
research
05/12/2023

Beware of diffusion models for synthesizing medical images – A comparison with GANs in terms of memorizing brain tumor images

Diffusion models were initially developed for text-to-image generation a...
research
09/19/2023

Assessing the capacity of a denoising diffusion probabilistic model to reproduce spatial context

Diffusion models have emerged as a popular family of deep generative mod...
research
08/29/2018

Chest X-ray Inpainting with Deep Generative Models

Generative adversarial networks have been successfully applied to inpain...
research
10/12/2022

3D Brain and Heart Volume Generative Models: A Survey

Generative models such as generative adversarial networks and autoencode...

Please sign up or login with your details

Forgot password? Click here to reset