Assessing the capacity of a denoising diffusion probabilistic model to reproduce spatial context

09/19/2023
by   Rucha Deshpande, et al.
0

Diffusion models have emerged as a popular family of deep generative models (DGMs). In the literature, it has been claimed that one class of diffusion models – denoising diffusion probabilistic models (DDPMs) – demonstrate superior image synthesis performance as compared to generative adversarial networks (GANs). To date, these claims have been evaluated using either ensemble-based methods designed for natural images, or conventional measures of image quality such as structural similarity. However, there remains an important need to understand the extent to which DDPMs can reliably learn medical imaging domain-relevant information, which is referred to as `spatial context' in this work. To address this, a systematic assessment of the ability of DDPMs to learn spatial context relevant to medical imaging applications is reported for the first time. A key aspect of the studies is the use of stochastic context models (SCMs) to produce training data. In this way, the ability of the DDPMs to reliably reproduce spatial context can be quantitatively assessed by use of post-hoc image analyses. Error-rates in DDPM-generated ensembles are reported, and compared to those corresponding to a modern GAN. The studies reveal new and important insights regarding the capacity of DDPMs to learn spatial context. Notably, the results demonstrate that DDPMs hold significant capacity for generating contextually correct images that are `interpolated' between training samples, which may benefit data-augmentation tasks in ways that GANs cannot.

READ FULL TEXT

page 2

page 5

page 6

page 7

page 8

page 9

page 10

research
04/26/2022

Assessing the ability of generative adversarial networks to learn canonical medical image statistics

In recent years, generative adversarial networks (GANs) have gained trem...
research
11/24/2021

A Method for Evaluating the Capacity of Generative Adversarial Networks to Reproduce High-order Spatial Context

Generative adversarial networks are a kind of deep generative model with...
research
04/07/2022

Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imaging

Modern generative models, such as generative adversarial networks (GANs)...
research
05/29/2020

Learning stochastic object models from medical imaging measurements using Progressively-Growing AmbientGANs

It has been advocated that medical imaging systems and reconstruction al...
research
06/27/2021

Learning stochastic object models from medical imaging measurements by use of advanced AmbientGANs

In order to objectively assess new medical imaging technologies via comp...
research
10/21/2022

Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report

Despite the ever-increasing interest in applying deep learning (DL) mode...
research
01/26/2020

Progressively-Growing AmbientGANs For Learning Stochastic Object Models From Imaging Measurements

The objective optimization of medical imaging systems requires full char...

Please sign up or login with your details

Forgot password? Click here to reset