A Long Short-term Memory Based Recurrent Neural Network for Interventional MRI Reconstruction

by   Ruiyang Zhao, et al.

Interventional magnetic resonance imaging (i-MRI) for surgical guidance could help visualize the interventional process such as deep brain stimulation (DBS), improving the surgery performance and patient outcome. Different from retrospective reconstruction in conventional dynamic imaging, i-MRI for DBS has to acquire and reconstruct the interventional images sequentially online. Here we proposed a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling. By using an initializer and Conv-LSTM blocks, the priors from the pre-operative reference image and intra-operative frames were exploited for reconstructing the current frame. Data consistency for radial sampling was implemented by a soft-projection method. An adversarial learning strategy was adopted to improve the reconstruction accuracy. A set of interventional images based on the pre-operative and post-operative MR images were simulated for algorithm validation. Results showed with only 10 radial spokes, ConvLR provided the best performance compared with state-of-the-art methods, giving an acceleration up to 40 folds. The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.


page 1

page 2

page 3

page 4

page 5

page 6


Undersampled MRI Reconstruction with Side Information-Guided Normalisation

Magnetic resonance (MR) images exhibit various contrasts and appearances...

On Real-time Image Reconstruction with Neural Networks for MRI-guided Radiotherapy

MRI-guidance techniques that dynamically adapt radiation beams to follow...

SANTIS: Sampling-Augmented Neural neTwork with Incoherent Structure for MR image reconstruction

Deep learning holds great promise in the reconstruction of undersampled ...

Brain Age Estimation Using LSTM on Children's Brain MRI

Brain age prediction based on children's brain MRI is an important bioma...

Self-supervised Recurrent Neural Network for 4D Abdominal and In-utero MR Imaging

Accurately estimating and correcting the motion artifacts are crucial fo...

Training recurrent neural networks robust to incomplete data: application to Alzheimer's disease progression modeling

Disease progression modeling (DPM) using longitudinal data is a challeng...

CNN-LSTM Based Multimodal MRI and Clinical Data Fusion for Predicting Functional Outcome in Stroke Patients

Clinical outcome prediction plays an important role in stroke patient ma...

Please sign up or login with your details

Forgot password? Click here to reset