Log In Sign Up

Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report

by   Pouria Rouzrokh, et al.

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that might be freely shared without compromising patient privacy is a well-known technique for addressing these difficulties. Inpainting algorithms are a subset of DL generative models that can alter one or more regions of an input image while matching its surrounding context and, in certain cases, non-imaging input conditions. Although the majority of inpainting techniques for medical imaging data use generative adversarial networks (GANs), the performance of these algorithms is frequently suboptimal due to their limited output variety, a problem that is already well-known for GANs. Denoising diffusion probabilistic models (DDPMs) are a recently introduced family of generative networks that can generate results of comparable quality to GANs, but with diverse outputs. In this paper, we describe a DDPM to execute multiple inpainting tasks on 2D axial slices of brain MRI with various sequences, and present proof-of-concept examples of its performance in a variety of evaluation scenarios. Our model and a public online interface to try our tool are available at:


page 2

page 4

page 5

page 9

page 10

page 11

page 14


Brain Tumor Synthetic Data Generation with Adaptive StyleGANs

Generative models have been very successful over the years and have rece...

Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks

Data diversity is critical to success when training deep learning models...

Two approaches to inpainting microstructure with deep convolutional generative adversarial networks

Imaging is critical to the characterisation of materials. However, even ...

Morphology-preserving Autoregressive 3D Generative Modelling of the Brain

Human anatomy, morphology, and associated diseases can be studied using ...

Chest X-ray Inpainting with Deep Generative Models

Generative adversarial networks have been successfully applied to inpain...

3D Brain and Heart Volume Generative Models: A Survey

Generative models such as generative adversarial networks and autoencode...

Blind Inpainting of Large-scale Masks of Thin Structures with Adversarial and Reinforcement Learning

Several imaging applications (vessels, retina, plant roots, road network...

Code Repositories


Multitask Brain Tumor Inpainting with Diffusion Models

view repo