Self-supervised Recurrent Neural Network for 4D Abdominal and In-utero MR Imaging

08/28/2019
by   Tong Zhang, et al.
42

Accurately estimating and correcting the motion artifacts are crucial for 3D image reconstruction of the abdominal and in-utero magnetic resonance imaging (MRI). The state-of-art methods are based on slice-to-volume registration (SVR) where multiple 2D image stacks are acquired in three orthogonal orientations. In this work, we present a novel reconstruction pipeline that only needs one orientation of 2D MRI scans and can reconstruct the full high-resolution image without masking or registration steps. The framework consists of two main stages: the respiratory motion estimation using a self-supervised recurrent neural network, which learns the respiratory signals that are naturally embedded in the asymmetry relationship of the neighborhood slices and cluster them according to a respiratory state. Then, we train a 3D deconvolutional network for super-resolution (SR) reconstruction of the sparsely selected 2D images using integrated reconstruction and total variation loss. We evaluate the classification accuracy on 5 simulated images and compare our results with the SVR method in adult abdominal and in-utero MRI scans. The results show that the proposed pipeline can accurately estimate the respiratory state and reconstruct 4D SR volumes with better or similar performance to the 3D SVR pipeline with less than 20% sparsely selected slices. The method has great potential to transform the 4D abdominal and in-utero MRI in clinical practice.

READ FULL TEXT

page 6

page 7

research
11/11/2022

Self-Supervised Isotropic Superresolution Fetal Brain MRI

Superresolution T2-weighted fetal-brain magnetic-resonance imaging (FBMR...
research
09/25/2019

Deep Predictive Motion Tracking in Magnetic Resonance Imaging: Application to Fetal Imaging

Fetal magnetic resonance imaging (MRI) is challenged by uncontrollable, ...
research
11/22/2016

PVR: Patch-to-Volume Reconstruction for Large Area Motion Correction of Fetal MRI

In this paper we present a novel method for the correction of motion art...
research
09/19/2017

3D Reconstruction in Canonical Co-ordinate Space from Arbitrarily Oriented 2D Images

Limited capture range and the requirement to provide high quality initia...
research
08/16/2019

Variational Multi-Task MRI Reconstruction: Joint Reconstruction, Registration and Super-Resolution

Motion degradation is a central problem in Magnetic Resonance Imaging (M...
research
03/31/2022

Universal Lymph Node Detection in T2 MRI using Neural Networks

Purpose: Identification of abdominal Lymph Nodes (LN) that are suspiciou...
research
03/28/2022

A Long Short-term Memory Based Recurrent Neural Network for Interventional MRI Reconstruction

Interventional magnetic resonance imaging (i-MRI) for surgical guidance ...

Please sign up or login with your details

Forgot password? Click here to reset