Large Intestine 3D Shape Refinement Using Point Diffusion Models for Digital Phantom Generation

09/15/2023
by   Kaouther Mouheb, et al.
0

Accurate 3D modeling of human organs plays a crucial role in building computational phantoms for virtual imaging trials. However, generating anatomically plausible reconstructions of organ surfaces from computed tomography scans remains challenging for many structures in the human body. This challenge is particularly evident when dealing with the large intestine. In this study, we leverage recent advancements in geometric deep learning and denoising diffusion probabilistic models to refine the segmentation results of the large intestine. We begin by representing the organ as point clouds sampled from the surface of the 3D segmentation mask. Subsequently, we employ a hierarchical variational autoencoder to obtain global and local latent representations of the organ's shape. We train two conditional denoising diffusion models in the hierarchical latent space to perform shape refinement. To further enhance our method, we incorporate a state-of-the-art surface reconstruction model, allowing us to generate smooth meshes from the obtained complete point clouds. Experimental results demonstrate the effectiveness of our approach in capturing both the global distribution of the organ's shape and its fine details. Our complete refinement pipeline demonstrates remarkable enhancements in surface representation compared to the initial segmentation, reducing the Chamfer distance by 70 Earth Mover's distance by 6 diffusion models, and advanced surface reconstruction techniques, our proposed method offers a promising solution for accurately modeling the large intestine's surface and can easily be extended to other anatomical structures.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
10/12/2022

LION: Latent Point Diffusion Models for 3D Shape Generation

Denoising diffusion models (DDMs) have shown promising results in 3D poi...
research
03/14/2023

Controllable Mesh Generation Through Sparse Latent Point Diffusion Models

Mesh generation is of great value in various applications involving comp...
research
11/23/2022

Tetrahedral Diffusion Models for 3D Shape Generation

Recently, probabilistic denoising diffusion models (DDMs) have greatly a...
research
11/24/2022

DiffusionSDF: Conditional Generative Modeling of Signed Distance Functions

Probabilistic diffusion models have achieved state-of-the-art results fo...
research
08/18/2019

Geometric Disentanglement for Generative Latent Shape Models

Representing 3D shape is a fundamental problem in artificial intelligenc...
research
12/01/2020

DiffusionNet: Discretization Agnostic Learning on Surfaces

We introduce a new approach to deep learning on 3D surfaces, based on th...
research
11/25/2019

Shape Reconstruction by Learning Differentiable Surface Representations

Generative models that produce point clouds have emerged as a powerful t...

Please sign up or login with your details

Forgot password? Click here to reset