A Long Short-term Memory Based Recurrent Neural Network for Interventional MRI Reconstruction

03/28/2022
by   Ruiyang Zhao, et al.
0

Interventional magnetic resonance imaging (i-MRI) for surgical guidance could help visualize the interventional process such as deep brain stimulation (DBS), improving the surgery performance and patient outcome. Different from retrospective reconstruction in conventional dynamic imaging, i-MRI for DBS has to acquire and reconstruct the interventional images sequentially online. Here we proposed a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling. By using an initializer and Conv-LSTM blocks, the priors from the pre-operative reference image and intra-operative frames were exploited for reconstructing the current frame. Data consistency for radial sampling was implemented by a soft-projection method. An adversarial learning strategy was adopted to improve the reconstruction accuracy. A set of interventional images based on the pre-operative and post-operative MR images were simulated for algorithm validation. Results showed with only 10 radial spokes, ConvLR provided the best performance compared with state-of-the-art methods, giving an acceleration up to 40 folds. The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
03/07/2022

Undersampled MRI Reconstruction with Side Information-Guided Normalisation

Magnetic resonance (MR) images exhibit various contrasts and appearances...
research
02/10/2022

On Real-time Image Reconstruction with Neural Networks for MRI-guided Radiotherapy

MRI-guidance techniques that dynamically adapt radiation beams to follow...
research
12/08/2018

SANTIS: Sampling-Augmented Neural neTwork with Incoherent Structure for MR image reconstruction

Deep learning holds great promise in the reconstruction of undersampled ...
research
02/20/2020

Brain Age Estimation Using LSTM on Children's Brain MRI

Brain age prediction based on children's brain MRI is an important bioma...
research
08/28/2019

Self-supervised Recurrent Neural Network for 4D Abdominal and In-utero MR Imaging

Accurately estimating and correcting the motion artifacts are crucial fo...
research
03/17/2019

Training recurrent neural networks robust to incomplete data: application to Alzheimer's disease progression modeling

Disease progression modeling (DPM) using longitudinal data is a challeng...
research
05/11/2022

CNN-LSTM Based Multimodal MRI and Clinical Data Fusion for Predicting Functional Outcome in Stroke Patients

Clinical outcome prediction plays an important role in stroke patient ma...

Please sign up or login with your details

Forgot password? Click here to reset