DeepAI
Log In Sign Up

Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report

10/21/2022
by   Pouria Rouzrokh, et al.
42

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that might be freely shared without compromising patient privacy is a well-known technique for addressing these difficulties. Inpainting algorithms are a subset of DL generative models that can alter one or more regions of an input image while matching its surrounding context and, in certain cases, non-imaging input conditions. Although the majority of inpainting techniques for medical imaging data use generative adversarial networks (GANs), the performance of these algorithms is frequently suboptimal due to their limited output variety, a problem that is already well-known for GANs. Denoising diffusion probabilistic models (DDPMs) are a recently introduced family of generative networks that can generate results of comparable quality to GANs, but with diverse outputs. In this paper, we describe a DDPM to execute multiple inpainting tasks on 2D axial slices of brain MRI with various sequences, and present proof-of-concept examples of its performance in a variety of evaluation scenarios. Our model and a public online interface to try our tool are available at: https://github.com/Mayo-Radiology-Informatics-Lab/MBTI

READ FULL TEXT

page 2

page 4

page 5

page 9

page 10

page 11

page 14

12/04/2022

Brain Tumor Synthetic Data Generation with Adaptive StyleGANs

Generative models have been very successful over the years and have rece...
07/26/2018

Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks

Data diversity is critical to success when training deep learning models...
10/13/2022

Two approaches to inpainting microstructure with deep convolutional generative adversarial networks

Imaging is critical to the characterisation of materials. However, even ...
09/07/2022

Morphology-preserving Autoregressive 3D Generative Modelling of the Brain

Human anatomy, morphology, and associated diseases can be studied using ...
08/29/2018

Chest X-ray Inpainting with Deep Generative Models

Generative adversarial networks have been successfully applied to inpain...
10/12/2022

3D Brain and Heart Volume Generative Models: A Survey

Generative models such as generative adversarial networks and autoencode...
12/05/2019

Blind Inpainting of Large-scale Masks of Thin Structures with Adversarial and Reinforcement Learning

Several imaging applications (vessels, retina, plant roots, road network...

Code Repositories

MBTI

Multitask Brain Tumor Inpainting with Diffusion Models


view repo