Two-and-a-half Order Score-based Model for Solving 3D Ill-posed Inverse Problems

08/16/2023
by   Zirong Li, et al.
0

Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) are crucial technologies in the field of medical imaging. Score-based models have proven to be effective in addressing different inverse problems encountered in CT and MRI, such as sparse-view CT and fast MRI reconstruction. However, these models face challenges in achieving accurate three dimensional (3D) volumetric reconstruction. The existing score-based models primarily focus on reconstructing two dimensional (2D) data distribution, leading to inconsistencies between adjacent slices in the reconstructed 3D volumetric images. To overcome this limitation, we propose a novel two-and-a-half order score-based model (TOSM). During the training phase, our TOSM learns data distributions in 2D space, which reduces the complexity of training compared to directly working on 3D volumes. However, in the reconstruction phase, the TOSM updates the data distribution in 3D space, utilizing complementary scores along three directions (sagittal, coronal, and transaxial) to achieve a more precise reconstruction. The development of TOSM is built on robust theoretical principles, ensuring its reliability and efficacy. Through extensive experimentation on large-scale sparse-view CT and fast MRI datasets, our method demonstrates remarkable advancements and attains state-of-the-art results in solving 3D ill-posed inverse problems. Notably, the proposed TOSM effectively addresses the inter-slice inconsistency issue, resulting in high-quality 3D volumetric reconstruction.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

page 9

research
09/18/2023

vSHARP: variable Splitting Half-quadratic ADMM algorithm for Reconstruction of inverse-Problems

Medical Imaging (MI) tasks, such as accelerated Parallel Magnetic Resona...
research
03/21/2020

Applications of Deep Learning for Ill-Posed Inverse Problems Within Optical Tomography

Increasingly in medical imaging has emerged an issue surrounding the rec...
research
01/06/2020

Deep Learning-Based Solvability of Underdetermined Inverse Problems in Medical Imaging

Recently, with the significant developments in deep learning techniques,...
research
03/15/2023

Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models

Diffusion models have become a popular approach for image generation and...
research
10/10/2022

Loop Unrolled Shallow Equilibrium Regularizer (LUSER) – A Memory-Efficient Inverse Problem Solver

In inverse problems we aim to reconstruct some underlying signal of inte...
research
08/01/2020

Multi-Slice Fusion for Sparse-View and Limited-Angle 4D CT Reconstruction

Inverse problems spanning four or more dimensions such as space, time an...
research
07/24/2023

Spatiotemporal Modeling Encounters 3D Medical Image Analysis: Slice-Shift UNet with Multi-View Fusion

As a fundamental part of computational healthcare, Computer Tomography (...

Please sign up or login with your details

Forgot password? Click here to reset