Rethinking Medical Image Reconstruction via Shape Prior, Going Deeper and Faster: Deep Joint Indirect Registration and Reconstruction

12/16/2019
by   Jiulong Liu, et al.
41

Indirect image registration is a promising technique to improve image reconstruction quality by providing a shape prior for the reconstruction task. In this paper, we propose a novel hybrid method that seeks to reconstruct high quality images from few measurements whilst requiring low computational cost. With this purpose, our framework intertwines indirect registration and reconstruction tasks is a single functional. It is based on two major novelties. Firstly, we introduce a model based on deep nets to solve the indirect registration problem, in which the inversion and registration mappings are recurrently connected through a fixed-point interaction based sparse optimisation. Secondly, we introduce specific inversion blocks, that use the explicit physical forward operator, to map the acquired measurements to the image reconstruction. We also introduce registration blocks based deep nets to predict the registration parameters and warp transformation accurately and efficiently. We demonstrate, through extensive numerical and visual experiments, that our framework outperforms significantly classic reconstruction schemes and other bi-task method; this in terms of both image quality and computational time. Finally, we show generalisation capabilities of our approach by demonstrating their performance on fast Magnetic Resonance Imaging (MRI), sparse view computed tomography (CT) and low dose CT with measurements much below the Nyquist limit.

READ FULL TEXT

page 17

page 18

page 19

page 22

research
09/29/2020

Deep Image Reconstruction using Unregistered Measurements without Groundtruth

One of the key limitations in conventional deep learning based image rec...
research
03/28/2023

DDMM-Synth: A Denoising Diffusion Model for Cross-modal Medical Image Synthesis with Sparse-view Measurement Embedding

Reducing the radiation dose in computed tomography (CT) is important to ...
research
06/27/2019

Computed tomography medical image reconstruction on affordable equipment by using out-of-core techniques

As Computed Tomography (CT) scans are an essential medical test, many te...
research
12/09/2018

A New Variational Model for Joint Image Reconstruction and Motion Estimation in Spatiotemporal Imaging

We propose a new variational model for joint image reconstruction and mo...
research
12/13/2021

Hybrid Atlas Building with Deep Registration Priors

Registration-based atlas building often poses computational challenges i...
research
06/04/2018

Image reconstruction through metamorphosis

This article adapts the framework of metamorphosis to solve inverse prob...
research
06/13/2017

Indirect Image Registration with Large Diffeomorphic Deformations

The paper adapts the large deformation diffeomorphic metric mapping fram...

Please sign up or login with your details

Forgot password? Click here to reset