Diffusion Deformable Model for 4D Temporal Medical Image Generation

06/27/2022
by   Boah Kim, et al.
0

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been extensively studied, approaches for temporal medical image generation such as 4D cardiac volume data are limited. In this work, we present a novel deep learning model that generates intermediate temporal volumes between source and target volumes. Specifically, we propose a diffusion deformable model (DDM) by adapting the denoising diffusion probabilistic model that has recently been widely investigated for realistic image generation. Our proposed DDM is composed of the diffusion and the deformation modules so that DDM can learn spatial deformation information between the source and target volumes and provide a latent code for generating intermediate frames along a geodesic path. Once our model is trained, the latent code estimated from the diffusion module is simply interpolated and fed into the deformation module, which enables DDM to generate temporal frames along the continuous trajectory while preserving the topology of the source image. We demonstrate the proposed method with the 4D cardiac MR image generation between the diastolic and systolic phases for each subject. Compared to the existing deformation methods, our DDM achieves high performance on temporal volume generation.

READ FULL TEXT
research
07/22/2023

FSDiffReg: Feature-wise and Score-wise Diffusion-guided Unsupervised Deformable Image Registration for Cardiac Images

Unsupervised deformable image registration is one of the challenging tas...
research
03/27/2023

Diffusion Models for Memory-efficient Processing of 3D Medical Images

Denoising diffusion models have recently achieved state-of-the-art perfo...
research
12/16/2022

SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generation

Human organs constantly undergo anatomical changes due to a complex mix ...
research
11/07/2022

Medical Diffusion – Denoising Diffusion Probabilistic Models for 3D Medical Image Generation

Recent advances in computer vision have shown promising results in image...
research
07/19/2023

Text2Layer: Layered Image Generation using Latent Diffusion Model

Layer compositing is one of the most popular image editing workflows amo...
research
08/12/2018

Unsupervised learning for cross-domain medical image synthesis using deformation invariant cycle consistency networks

Recently, the cycle-consistent generative adversarial networks (CycleGAN...
research
04/06/2020

Multimodal Medical Volume Colorization from 2D Style

Colorization involves the synthesis of colors on a target image while pr...

Please sign up or login with your details

Forgot password? Click here to reset